00010000:00010000:1.0F:1788620085.386333:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788620086.024745:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:1.0:1788620086.024757:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9333836d3000 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:1.0:1788620086.024763:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333a52c5e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9333836d36c0 00000020:00080000:1.0:1788620086.024767:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9333a52c5800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff933284393000 00000001:00080000:1.0:1788620086.024808:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1788620086.024820:0:14519:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:1.0:1788620086.025006:0:14519:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0F:1788620086.406995:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620087.434723:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1788620087.950688:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620087.950820:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657122048 00000100:00100000:1.0:1788620087.950830:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657122048 00000100:00100000:1.0:1788620087.950908:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:1.0:1788620087.950918:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+12:14460:x1875503657122048:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788620087.951020:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+12:14460:x1875503657122048:12345-192.168.203.12@tcp:60:lhsmtool_posix.0 Request processed in 104us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620087.951028:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00080000:0.0F:1788620087.951488:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620087.959326:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620087.959418:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657122304 00000100:00100000:3.0:1788620087.959428:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657122304 00000100:00100000:3.0:1788620087.959498:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788620087.959507:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+12:14460:x1875503657122304:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788620087.959768:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+13:14460:x1875503657122304:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 261us (461us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788620087.959809:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00010000:00010000:1.0:1788620088.454996:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620089.480046:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620089.543864:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677027328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788620089.543946:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620089.544012:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677027840:0@lo:400:kworker.0 00000100:00100000:0.0:1788620089.544025:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677027712:0@lo:400:kworker.0 00000100:00100000:2.0:1788620089.544036:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620089.544050:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620089.544054:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788620089.544060:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677027456:0@lo:400:kworker.0 00000100:00100000:0.0:1788620089.544066:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788620089.544070:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677027584:0@lo:400:kworker.0 00000100:00100000:2.0:1788620089.544085:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620089.544091:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620089.544104:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677027968:0@lo:400:kworker.0 00000100:00100000:0.0:1788620089.544115:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677027840 00000100:00100000:0.0:1788620089.544122:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677027840 00000100:00100000:2.0:1788620089.544123:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620089.544165:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677027712 00000100:00100000:0.0:1788620089.544165:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677027968 00000100:00100000:2.0:1788620089.544168:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677027712 00000100:00100000:0.0:1788620089.544168:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677027968 00000100:00100000:0.0:1788620089.544186:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788620089.544223:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677027328 00000100:00100000:1.0:1788620089.544228:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677027328 00000100:00100000:1.0:1788620089.544257:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788620089.544265:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677027328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788620089.544388:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620089.544447:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677027328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620089.544454:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620089.544639:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788620089.544641:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677027840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620089.544647:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677027968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620089.544674:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677027968:12345-0@lo:400:kworker.0 Request processed in 28us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620089.544680:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788620089.544683:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677027840:12345-0@lo:400:kworker.0 Request processed in 492us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620089.544689:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788620089.544694:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788620089.544699:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677027712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620089.544707:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677027584 00000100:00100000:0.0:1788620089.544710:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677027584 00000100:00100000:2.0:1788620089.544731:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677027712:12345-0@lo:400:kworker.0 Request processed in 31us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620089.544732:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788620089.544736:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788620089.544738:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677027584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620089.544753:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677027456 00000100:00100000:2.0:1788620089.544757:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677027456 00000100:00100000:0.0:1788620089.544791:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677027584:12345-0@lo:400:kworker.0 Request processed in 33us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620089.544795:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788620089.544797:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788620089.544800:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3309:x1875503677027456:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788620089.544823:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788620089.544827:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788620089.544830:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620089.544843:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5efac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3309:x1875503677027456:12345-0@lo:400:kworker.0 Request processed in 43us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620089.544960:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677027584:0@lo:400:kworker.0 00000100:00100000:2.0:1788620089.544985:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788620089.545017:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677028096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620089.545042:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620089.545069:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677028096 00000100:00100000:2.0:1788620089.545074:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677028096 00000100:00100000:2.0:1788620089.545089:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788620089.545095:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677028096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620089.545113:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788620089.545206:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677027712:0@lo:400:kworker.0 00000100:00100000:3.0:1788620089.545253:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677028096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620089.545286:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677028096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620089.545292:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788620089.546102:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677027456:0@lo:400:kworker.0 00000100:00100000:0.0:1788620089.546116:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677027968:0@lo:400:kworker.0 00000100:00100000:0.0:1788620089.546126:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677027840:0@lo:400:kworker.0 00000100:00100000:0.0:1788620089.546155:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677027328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620089.755883:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620089.755924:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620089.756031:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620089.756112:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657122432 00000100:00100000:3.0:1788620089.756122:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657122432 00000100:00100000:3.0:1788620089.756195:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:3.0:1788620089.756206:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2355:x1875503657122432:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620089.756276:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2355:x1875503657122432:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 73us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620089.756284:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 125 00000100:00100000:2.0:1788620089.756599:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657122688 00000100:00100000:2.0:1788620089.756605:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657122688 00000100:00100000:2.0:1788620089.756702:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:2.0:1788620089.756709:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2355:x1875503657122688:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620089.756753:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2355:x1875503657122688:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 44us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620089.756759:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788620089.756953:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657122560 00000100:00100000:0.0:1788620089.756958:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657122560 00000100:00080000:1.0:1788620089.760208:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788620089.760223:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620089.760705:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788620089.760728:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+13:2355:x1875503657122560:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620089.760848:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+13:2355:x1875503657122560:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 125us (4816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620089.760856:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:2.0:1788620089.767542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620089.767585:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620089.767605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620089.767631:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620089.767660:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657122816 00000100:00100000:2.0:1788620089.767669:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657122816 00000100:00100000:3.0:1788620089.767675:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657123072 00000100:00100000:3.0:1788620089.767682:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657123072 00000100:00100000:3.0:1788620089.767931:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657123200 00000100:00100000:3.0:1788620089.767936:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657123200 00000100:00100000:3.0:1788620089.767960:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788620089.767969:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2353:x1875503657122816:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:3.0:1788620089.767999:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf486 00000100:00080000:3.0:1788620089.768015:0:15165:0:(import.c:65:import_set_state_nolock()) ffff933390dff800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788620089.768059:0:15165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788620089.768208:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788620089.768218:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2353:x1875503657123072:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1788620089.768235:0:15166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf4b7 00000100:00080000:2.0:1788620089.768247:0:15166:0:(import.c:65:import_set_state_nolock()) ffff9333bbc5b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788620089.768281:0:15166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788620089.768436:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb10b78-2640-4d1c-bba9-c870a1e66de6+2:2353:x1875503657122816:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 467us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620089.768484:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+2:2353:x1875503657123072:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 266us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620089.768533:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657122944 00000100:00100000:0.0:1788620089.768538:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657122944 00000100:00100000:0.0:1788620089.768571:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:0.0:1788620089.768578:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2354:x1875503657122944:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620089.768608:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2354:x1875503657122944:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 31us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620089.768615:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00080000:0.0:1788620089.768649:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788620089.768653:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788620089.768655:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788620089.768666:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620089.768682:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620089.768764:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788620089.770854:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788620089.770898:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788620089.770915:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2353:x1875503657123200:12345-192.168.203.12@tcp:9:kworker.0 00000020:00000080:2.0:1788620089.770949:0:15166:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf4be 00000100:00080000:2.0:1788620089.770960:0:15166:0:(import.c:65:import_set_state_nolock()) ffff9333bbc5a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788620089.771012:0:15166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788620089.771246:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+2:2353:x1875503657123200:12345-192.168.203.12@tcp:9:kworker.0 Request processed in 338us (3637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620089.771254:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00010000:00010000:0.0:1788620089.773055:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620090.504191:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788620091.150273:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000001:00080000:1.0:1788620091.150309:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788620091.150321:0:14519:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:1.0:1788620091.150332:0:14519:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:0.0:1788620091.527173:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788620092.186407:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9fa1a06f-2672-4b8a-a479-ea28f38363d8 00000020:00000080:3.0:1788620092.186415:0:6720:0:(genops.c:885:class_export_put()) final put ffff9333bbc5b000/9fa1a06f-2672-4b8a-a479-ea28f38363d8 00000020:00000080:3.0:1788620092.186453:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbc5b000/9fa1a06f-2672-4b8a-a479-ea28f38363d8 for lustre-OST0000 00000020:00000080:3.0:1788620092.186497:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bbc5b800 for lustre-OST0000 00010000:00010000:0.0:1788620092.551020:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620093.576463:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788620093.700904:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9fa1a06f-2672-4b8a-a479-ea28f38363d8 00000020:00000080:1.0:1788620093.700913:0:7647:0:(genops.c:885:class_export_put()) final put ffff9333bbc58000/9fa1a06f-2672-4b8a-a479-ea28f38363d8 00000001:00100000:1.0:1788620093.700957:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6eb10b78-2640-4d1c-bba9-c870a1e66de6 00000020:00000080:1.0:1788620093.700960:0:7647:0:(genops.c:885:class_export_put()) final put ffff933390df8000/6eb10b78-2640-4d1c-bba9-c870a1e66de6 00000020:00000080:2.0:1788620093.701018:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbc58000/9fa1a06f-2672-4b8a-a479-ea28f38363d8 for lustre-OST0001 00000020:00000080:2.0:1788620093.701076:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933390df8000/6eb10b78-2640-4d1c-bba9-c870a1e66de6 for lustre-OST0001 00000020:00000080:2.0:1788620093.701091:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bbc5a000 for lustre-OST0001 00000020:00000080:2.0:1788620093.701096:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933390dff800 for lustre-OST0001 00000040:00080000:1.0:1788620094.343154:0:14513:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788620094.343162:0:14513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788620094.343202:0:14513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788620094.343208:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788620094.598888:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620094.667962:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677028224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620094.668031:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620094.668081:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677028736:0@lo:400:kworker.0 00000100:00100000:3.0:1788620094.668106:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620094.668131:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788620094.668137:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677028608:0@lo:400:kworker.0 00000100:00100000:3.0:1788620094.668159:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620094.668197:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677028224 00000100:00100000:3.0:1788620094.668204:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677028224 00000100:00100000:3.0:1788620094.668256:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788620094.668276:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677028224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788620094.668309:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788620094.668351:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677028224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620094.668358:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788620094.668381:0:16239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677028736 00000100:00100000:3.0:1788620094.668385:0:16239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677028736 00000100:00100000:3.0:1788620094.668411:0:16239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788620094.668433:0:16239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677028736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620094.668465:0:16239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677028736:12345-0@lo:400:kworker.0 Request processed in 34us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620094.668472:0:16239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788620094.668507:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677028608 00000100:00100000:3.0:1788620094.668511:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677028608 00000100:00100000:3.0:1788620094.668539:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788620094.668545:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677028608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620094.668574:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677028608:12345-0@lo:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620094.668579:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788620094.668594:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788620094.668597:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620094.668631:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677028608:0@lo:400:kworker.0 00000100:00100000:3.0:1788620094.668645:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677028224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620094.668653:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677028736:0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.668903:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677028480:0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.668934:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620094.668955:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.668977:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620094.668997:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788620094.669003:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677028352:0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669027:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620094.669050:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503677028864:0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669070:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620094.669096:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677028480 00000100:00100000:1.0:1788620094.669107:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677028480 00000100:00100000:1.0:1788620094.669134:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788620094.669141:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677028480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669176:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677028480:12345-0@lo:400:kworker.0 Request processed in 36us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620094.669182:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788620094.669199:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677028992 00000100:00100000:1.0:1788620094.669202:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677028992 00000100:00100000:1.0:1788620094.669229:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677028864 00000100:00100000:1.0:1788620094.669232:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677028864 00000100:00100000:1.0:1788620094.669250:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788620094.669255:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677028992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669297:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677028992:12345-0@lo:400:kworker.0 Request processed in 42us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620094.669302:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788620094.669314:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788620094.669320:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503677028864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669344:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503677028864:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620094.669350:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788620094.669367:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677028352 00000100:00100000:1.0:1788620094.669370:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677028352 00000100:00100000:1.0:1788620094.669395:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788620094.669401:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3310:x1875503677028352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669429:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3310:x1875503677028352:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620094.669435:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788620094.669475:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620094.669515:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677028352:0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669527:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503677028864:0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669535:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc455f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677028480:0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669544:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788620094.669571:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620094.669577:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677029120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620094.669602:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620094.669628:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677029120 00000100:00100000:1.0:1788620094.669631:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677029120 00000100:00100000:1.0:1788620094.669654:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788620094.669661:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677029120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788620094.669684:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620094.669718:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677029120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620094.669724:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788620094.669752:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677029120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620094.877108:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620094.877155:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620094.877186:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620094.877211:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620094.877239:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657123584 00000100:00100000:3.0:1788620094.877249:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657123584 00000100:00100000:3.0:1788620094.877324:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788620094.877334:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2355:x1875503657123584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620094.877407:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2355:x1875503657123584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620094.877440:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788620094.877464:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657123456 00000100:00100000:3.0:1788620094.877468:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657123456 00000100:00100000:1.0:1788620094.877597:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657123328 00000100:00100000:1.0:1788620094.877601:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657123328 00000100:00100000:1.0:1788620094.877631:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:1.0:1788620094.877638:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2355:x1875503657123328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788620094.877667:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2355:x1875503657123328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620094.877673:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 127 00000100:00100000:3.0:1788620094.877901:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657123712 00000100:00100000:3.0:1788620094.877906:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657123712 00000100:00100000:3.0:1788620094.877931:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1788620094.877938:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+12:2355:x1875503657123456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620094.877971:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+12:2355:x1875503657123456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620094.877978:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:3.0:1788620094.877992:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:3.0:1788620094.877999:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2355:x1875503657123712:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620094.878024:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2355:x1875503657123712:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620094.878030:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00080000:3.0:1788620094.878051:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788620094.878055:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788620095.625123:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620096.650038:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620097.670986:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620098.701736:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788620098.935491:0:17418:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:54:58 (1788620098) 00010000:00010000:1.0:1788620099.720154:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620099.783149:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620099.783194:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677029376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620099.783257:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620099.783271:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677029248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620099.783311:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620099.783351:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677029376 00000100:00100000:3.0:1788620099.783363:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677029376 00000100:00100000:1.0:1788620099.783401:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620099.783428:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677029248 00000100:00100000:1.0:1788620099.783432:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677029248 00000100:00100000:3.0:1788620099.783438:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788620099.783448:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677029376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620099.783500:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788620099.783518:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677029632:0@lo:400:kworker.0 00000100:00100000:1.0:1788620099.783551:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620099.783566:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677029376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620099.783570:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620099.783574:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788620099.783575:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333902c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677029760:0@lo:400:kworker.0 00000100:00100000:3.0:1788620099.783596:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788620099.783597:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620099.783602:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677029248:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620099.783623:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677029632 00000100:00100000:1.0:1788620099.783627:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677029632 00000100:00100000:1.0:1788620099.783656:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677029760 00000100:00100000:1.0:1788620099.783659:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677029760 00000100:00100000:1.0:1788620099.783685:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788620099.783691:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677029632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620099.783729:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677029632:12345-0@lo:400:kworker.0 Request processed in 39us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620099.783735:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788620099.783757:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788620099.783763:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677029760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620099.783817:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677029760:12345-0@lo:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620099.783823:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00002000:00000024:3.0:1788620099.783852:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788620099.783881:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677029248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 279us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620099.783885:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333902c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677029760:0@lo:400:kworker.0 00000100:00100000:3.0:1788620099.783887:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788620099.783897:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677029632:0@lo:400:kworker.0 00000100:00080000:3.0:1788620099.783905:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788620099.783909:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620099.783912:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620099.783912:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677029248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620099.783945:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788620099.783979:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620099.784023:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677029376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620099.784034:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620099.784040:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677029888:0@lo:400:kworker.0 00000100:00100000:1.0:1788620099.784062:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620099.784087:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677029888 00000100:00100000:1.0:1788620099.784090:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677029888 00000100:00100000:3.0:1788620099.784116:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677029504 00000100:00100000:1.0:1788620099.784117:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788620099.784120:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677029504 00000100:00100000:1.0:1788620099.784124:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677029888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620099.784157:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677029888:12345-0@lo:400:kworker.0 Request processed in 34us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620099.784163:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788620099.784178:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620099.784192:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bb920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677029888:0@lo:400:kworker.0 00000100:00100000:3.0:1788620099.784221:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788620099.784241:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3310:x1875503677029504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620099.784285:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3310:x1875503677029504:12345-0@lo:400:kworker.0 Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620099.784291:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788620099.784446:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd2fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:937205a0-294a-4965-a8b3-aa80c7ce7507:3310:1875503677029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788620099.997970:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620099.998019:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620099.998044:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620099.998071:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620099.998101:0:15945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657124096 00000100:00100000:1.0:1788620099.998119:0:15945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657124096 00000100:00100000:1.0:1788620099.998184:0:15945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788620099.998195:0:15945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2355:x1875503657124096:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788620099.998290:0:15945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2355:x1875503657124096:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620099.998298:0:15945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788620099.998321:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657123968 00000100:00100000:1.0:1788620099.998325:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657123968 00000100:00100000:1.0:1788620099.998350:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657124224 00000100:00100000:1.0:1788620099.998354:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657124224 00000100:00100000:1.0:1788620099.998373:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1788620099.998379:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+12:2355:x1875503657123968:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788620099.999947:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+12:2355:x1875503657123968:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 1558us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620099.999958:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1788620099.999986:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788620100.000002:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2355:x1875503657124224:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788620100.000041:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2355:x1875503657124224:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 48us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620100.000047:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00080000:1.0:1788620100.000073:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788620100.000077:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788620100.000429:0:14472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657123840 00000100:00100000:2.0:1788620100.000438:0:14472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657123840 00000100:00100000:2.0:1788620100.000482:0:14472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 129 00000100:00100000:2.0:1788620100.000490:0:14472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2355:x1875503657123840:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620100.000525:0:14472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2355:x1875503657123840:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 36us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620100.000544:0:14472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 129 00010000:00010000:3.0:1788620100.742988:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620101.768700:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620102.642249:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620102.642874:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657124480 00000100:00100000:0.0:1788620102.642886:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657124480 00000100:00100000:0.0:1788620102.642976:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788620102.642988:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+12:15343:x1875503657124480:12345-192.168.203.12@tcp:35:umount.0 00000001:00080000:0.0:1788620102.643356:0:14482:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:0.0:1788620102.643491:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+14:15343:x1875503657124480:12345-192.168.203.12@tcp:35:umount.0 Request processed in 505us (1252us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1788620102.643501:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000020:00080000:0.0:1788620102.643506:0:14482:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1788620102.644815:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620102.651917:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620102.651963:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620102.652005:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620102.652193:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657124608 00000100:00100000:1.0:1788620102.652203:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657124608 00000100:00100000:1.0:1788620102.652276:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657124864 00000100:00100000:1.0:1788620102.652279:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657124864 00000100:00100000:1.0:1788620102.652290:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657124736 00000100:00100000:1.0:1788620102.652293:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657124736 00000100:00100000:1.0:1788620102.652307:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788620102.652316:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bacb4971-66f0-437c-a1c9-1227bfa78e13+15:2355:x1875503657124608:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620102.652330:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620102.652348:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333b8b31600/0xbb0e330328bbf463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac8f expref: 15 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620102.652366:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620102.652422:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bacb4971-66f0-437c-a1c9-1227bfa78e13+14:2355:x1875503657124608:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 106us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620102.652429:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788620102.652445:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788620102.652452:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bafb1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bacb4971-66f0-437c-a1c9-1227bfa78e13+13:2355:x1875503657124864:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620102.652462:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620102.652470:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c3a00/0xbb0e330328bbf50b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad5a expref: 13 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620102.652480:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620102.652497:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bafb1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:2355:x1875503657124864:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 46us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620102.652503:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788620102.652766:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788620102.652817:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:2355:x1875503657124736:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620102.652827:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620102.652844:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c3000/0xbb0e330328bbf46a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acb9 expref: 11 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620102.652854:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620102.652873:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:2355:x1875503657124736:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 59us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620102.652879:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788620102.657605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620102.657702:0:15164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657124992 00000100:00100000:3.0:1788620102.657715:0:15164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657124992 00000100:00100000:3.0:1788620102.657861:0:15164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788620102.657874:0:15164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+5:2353:x1875503657124992:12345-192.168.203.12@tcp:9:umount.0 00000020:00000080:3.0:1788620102.657921:0:15164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf47f 00000100:00080000:3.0:1788620102.657932:0:15164:0:(import.c:65:import_set_state_nolock()) ffff9333bbd74000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788620102.657990:0:15164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788620102.658387:0:15164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6eb10b78-2640-4d1c-bba9-c870a1e66de6+2:2353:x1875503657124992:12345-192.168.203.12@tcp:9:umount.0 Request processed in 515us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620102.658397:0:15164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00080000:1.0:1788620102.658665:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788620102.659047:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620102.678113:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620102.678258:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657125888 00000100:00100000:1.0:1788620102.678272:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657125888 00000100:00100000:1.0:1788620102.678354:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788620102.678367:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+14:2353:x1875503657125888:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:1.0:1788620102.678423:0:14481:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf478 00000020:00010000:1.0:1788620102.678447:0:14481:0:(genops.c:1921:obd_stale_export_put()) Put export ffff933385809800: total 0 00000100:00080000:1.0:1788620102.678454:0:14481:0:(import.c:65:import_set_state_nolock()) ffff93338580a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788620102.678491:0:14481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:1.0:1788620102.679229:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc10f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb10b78-2640-4d1c-bba9-c870a1e66de6+13:2353:x1875503657125888:12345-192.168.203.12@tcp:39:umount.0 Request processed in 857us (1138us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1788620102.679241:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000020:00010000:0.0:1788620102.679845:0:14468:0:(genops.c:1907:obd_stale_export_get()) Get export ffff933385809800: total 0 00010000:00010000:0.0:1788620102.679953:0:14468:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff933385809800, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788620102.680000:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:0.0:1788620102.680016:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620102.680030:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142600/0xbb0e330328bbf57b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad76 expref: 12 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620102.680053:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff933390117e00) 00010000:00010000:0.0:1788620102.680056:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620102.680062:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143e00/0xbb0e330328bbf527 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad61 expref: 11 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620102.680086:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff933383b59e00) 00010000:00010000:0.0:1788620102.680088:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788620102.680092:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b30c00/0xbb0e330328bbf600 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ada0 expref: 10 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620102.680111:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff933383b59b00) 00010000:00010000:0.0:1788620102.680114:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788620102.680117:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbf6fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aded expref: 9 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620102.680150:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:0.0:1788620102.680152:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788620102.680157:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbf67e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06adca expref: 8 pid: 16239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620102.680169:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff933383b59100) 00010000:00010000:0.0:1788620102.680171:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620102.680175:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbf6a1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06add8 expref: 7 pid: 14481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620102.680190:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff933388291e00) 00010000:00010000:0.0:1788620102.680192:0:14468:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620102.680196:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333b8b31800/0xbb0e330328bbf543 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad68 expref: 6 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620102.680221:0:14468:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff933385809800, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1788620102.680235:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620102.680237:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620102.680239:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620102.791189:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620103.821310:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788620104.582992:0:14513:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788620104.583001:0:14513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788620104.583032:0:14513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788620104.583038:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788620104.840410:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620104.890956:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620104.891009:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620104.891136:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620104.895276:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657126144 00000100:00100000:0.0:1788620104.895298:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657126144 00000100:00100000:0.0:1788620104.895390:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657126016 00000100:00100000:0.0:1788620104.895394:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657126016 00000100:00100000:0.0:1788620104.895447:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657126272 00000100:00100000:0.0:1788620104.895451:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657126272 00000100:00100000:0.0:1788620104.895480:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788620104.895492:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bacb4971-66f0-437c-a1c9-1227bfa78e13+12:2355:x1875503657126144:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620104.895512:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620104.895541:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813ce600/0xbb0e330328bbf4a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad1b expref: 12 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620104.895567:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620104.895657:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bacb4971-66f0-437c-a1c9-1227bfa78e13+11:2355:x1875503657126144:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 166us (4715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620104.895667:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:0.0:1788620104.895692:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788620104.895700:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bacb4971-66f0-437c-a1c9-1227bfa78e13+10:2355:x1875503657126016:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620104.895709:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620104.895719:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333b8b31400/0xbb0e330328bbf49b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06acf1 expref: 10 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620104.895729:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620104.895750:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bacb4971-66f0-437c-a1c9-1227bfa78e13+9:2355:x1875503657126016:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 50us (4740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620104.895757:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788620104.895822:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:0.0:1788620104.895830:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bacb4971-66f0-437c-a1c9-1227bfa78e13+8:2355:x1875503657126272:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620104.895838:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620104.895860:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc142a00/0xbb0e330328bbf504 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad53 expref: 8 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620104.895880:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788620104.895914:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bacb4971-66f0-437c-a1c9-1227bfa78e13+7:2355:x1875503657126272:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 85us (4779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620104.895920:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788620104.905131:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677030016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620104.905254:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620104.906248:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:937205a0-294a-4965-a8b3-aa80c7ce7507:3312:1875503677030272:0@lo:400:kworker.0 00000100:00100000:3.0:1788620104.906302:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620104.906329:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788620104.906336:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677030144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620104.906372:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620104.906401:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677030272 00000100:00100000:3.0:1788620104.906408:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677030272 00000100:00100000:3.0:1788620104.906460:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788620104.906468:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3312:x1875503677030272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620104.906528:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3312:x1875503677030272:12345-0@lo:400:kworker.0 Request processed in 60us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620104.906535:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788620104.906569:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677030016 00000100:00100000:3.0:1788620104.906573:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677030016 00000100:00100000:3.0:1788620104.906598:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677030144 00000100:00100000:3.0:1788620104.906600:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677030144 00000100:00100000:3.0:1788620104.906613:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788620104.906620:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677030016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620104.906657:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788620104.906712:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677030016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620104.906719:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788620104.906742:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788620104.906748:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677030144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788620104.906768:0:15167:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788620104.906811:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677030144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620104.906817:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788620104.906864:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677030144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620104.906877:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:937205a0-294a-4965-a8b3-aa80c7ce7507:3312:1875503677030272:0@lo:400:kworker.0 00000100:00100000:3.0:1788620104.906914:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677030016:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788620104.906958:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788620104.906962:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620104.919984:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503677030528:0@lo:400:kworker.0 00000100:00100000:2.0:1788620104.920081:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620104.920138:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788620104.920144:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503677030400:0@lo:400:kworker.0 00000100:00100000:2.0:1788620104.920166:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620104.920212:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677030528 00000100:00100000:2.0:1788620104.920222:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677030528 00000100:00100000:2.0:1788620104.920291:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677030400 00000100:00100000:2.0:1788620104.920295:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677030400 00000100:00100000:2.0:1788620104.920321:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788620104.920331:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503677030528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620104.920465:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875503677030528:12345-0@lo:400:kworker.0 Request processed in 135us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620104.920473:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788620104.923404:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788620104.923437:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503677030400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620104.923560:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875503677030400:12345-0@lo:400:kworker.0 Request processed in 139us (3391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620104.923589:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788620104.923649:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620104.923701:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875503677030400:0@lo:400:kworker.0 00000100:00100000:1.0:1788620104.924167:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503677030656:0@lo:400:kworker.0 00000100:00100000:1.0:1788620104.924233:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620104.924318:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677030656 00000100:00100000:1.0:1788620104.924326:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677030656 00000100:00100000:1.0:1788620104.924392:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788620104.924400:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503677030656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620104.924443:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875503677030656:12345-0@lo:400:kworker.0 Request processed in 44us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620104.924459:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788620104.924503:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503677030656:0@lo:400:kworker.0 00000100:00080000:1.0:1788620104.924535:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620104.924973:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875503677030528:0@lo:400:kworker.0 00000100:00100000:2.0:1788620104.925305:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620104.926214:0:14481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657126528 00000100:00100000:1.0:1788620104.926226:0:14481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657126528 00000100:00100000:1.0:1788620104.926317:0:14481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788620104.926328:0:14481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+6:2353:x1875503657126528:12345-192.168.203.12@tcp:39:umount.0 00000020:00000080:1.0:1788620104.926385:0:14481:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf4b0 00000020:00010000:1.0:1788620104.926396:0:14481:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9333bbc5c000: total 0 00000100:00080000:1.0:1788620104.926401:0:14481:0:(import.c:65:import_set_state_nolock()) ffff9333bbc5f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788620104.926441:0:14481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1788620104.926995:0:14481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9fa1a06f-2672-4b8a-a479-ea28f38363d8+5:2353:x1875503657126528:12345-192.168.203.12@tcp:39:umount.0 Request processed in 664us (1687us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788620104.927005:0:14481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000020:00010000:0.0:1788620104.927905:0:14467:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9333bbc5c000: total 0 00010000:00010000:0.0:1788620104.927913:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620104.927974:0:14467:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9333bbc5c000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788620104.928016:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933390117d00) 00010000:00010000:0.0:1788620104.928021:0:14467:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620104.928033:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbf589 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ad7d expref: 4 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620104.928062:0:14467:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9333bbc5c000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788620104.928073:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620104.928075:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620104.928076:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788620104.931889:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620104.956992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620104.957165:0:14474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657126784 00000100:00100000:0.0:1788620104.957178:0:14474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657126784 00000100:00100000:0.0:1788620104.957262:0:14474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 131 00000100:00100000:0.0:1788620104.957274:0:14474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+7:2353:x1875503657126784:12345-192.168.203.12@tcp:251:umount.0 00000020:00000080:0.0:1788620104.957331:0:14474:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf455 00000020:00010000:0.0:1788620104.957340:0:14474:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9333bbd73000: total 0 00000100:00080000:0.0:1788620104.957345:0:14474:0:(import.c:65:import_set_state_nolock()) ffff93338920f000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788620104.957442:0:14474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bacb4971-66f0-437c-a1c9-1227bfa78e13+3:2353:x1875503657126784:12345-192.168.203.12@tcp:251:umount.0 Request processed in 169us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620104.957450:0:14474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 131 00000020:00010000:2.0:1788620104.957641:0:15949:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9333bbd73000: total 0 00010000:00010000:2.0:1788620104.957697:0:15949:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9333bbd73000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788620104.957753:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333b8b31c00/0xbb0e330328bbf45c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ac88 expref: 2 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620104.957828:0:15949:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9333bbd73000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788620104.957839:0:15949:0:(genops.c:885:class_export_put()) final put ffff9333bbd73000/bacb4971-66f0-437c-a1c9-1227bfa78e13 00010000:00010000:2.0:1788620104.958149:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620104.958151:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620104.958154:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788620104.958204:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbd73000/bacb4971-66f0-437c-a1c9-1227bfa78e13 for MGS 00000020:00000080:3.0:1788620104.958255:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93338920f000 for MGS 00010000:00010000:3.0:1788620105.869673:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788620106.488722:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000001:00100000:1.0:1788620106.488748:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9fa1a06f-2672-4b8a-a479-ea28f38363d8 00000001:00080000:1.0:1788620106.488755:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1788620106.488758:0:5864:0:(genops.c:885:class_export_put()) final put ffff9333bbc5c000/9fa1a06f-2672-4b8a-a479-ea28f38363d8 00000001:00100000:1.0:1788620106.488805:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6eb10b78-2640-4d1c-bba9-c870a1e66de6 00000001:00080000:1.0:1788620106.488810:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:1.0:1788620106.488812:0:5864:0:(genops.c:885:class_export_put()) final put ffff933385809800/6eb10b78-2640-4d1c-bba9-c870a1e66de6 00000020:00000080:1.0:1788620106.488827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbc5c000/9fa1a06f-2672-4b8a-a479-ea28f38363d8 for lustre-MDT0000 00000020:00000080:1.0:1788620106.488898:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff933385809800/6eb10b78-2640-4d1c-bba9-c870a1e66de6 for lustre-MDT0000 00000020:00000080:1.0:1788620106.488934:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bbc5f000 for lustre-MDT0000 00000020:00000080:1.0:1788620106.488939:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93338580a800 for lustre-MDT0000 00010000:00010000:1.0:1788620106.887509:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788620107.287531:0:17613:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788620107.310985:0:17613:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788620107.311051:0:17613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.311068:0:17613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.311076:0:17613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.311104:0:17613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.311128:0:17613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788620107.311135:0:17613:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788620107.311184:0:17613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788620107.311189:0:17613:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788620107.311197:0:17613:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788620107.311234:0:17613:0:(import.c:65:import_set_state_nolock()) ffff9333836dc000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788620107.311316:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677030784:0@lo:39:umount.0 00000100:00100000:0.0:1788620107.311414:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788620107.311603:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620107.311612:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.311620:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3200 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620107.311624:0:15949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.311634:0:15949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620107.311643:0:15949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620107.311658:0:15949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620107.311661:0:15949:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788620107.311663:0:15949:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788620107.311697:0:15949:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.311705:0:15949:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620107.311736:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.311744:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3200/0xbb0e330328bbf184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf18b expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.311757:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620107.311759:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620107.311761:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620107.311931:0:14479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677030784 00000100:00100000:1.0:1788620107.311940:0:14479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677030784 00000100:00100000:1.0:1788620107.312005:0:14479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788620107.312015:0:14479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875503677030784:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788620107.312043:0:14479:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf1b5 00000100:00080000:1.0:1788620107.312053:0:14479:0:(import.c:65:import_set_state_nolock()) ffff9333a53c5800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788620107.312181:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:937205a0-294a-4965-a8b3-aa80c7ce7507:3312:1875503677030912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620107.312220:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620107.317321:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677030912 00000100:00100000:3.0:1788620107.317343:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677030912 00000100:00100000:3.0:1788620107.317450:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788620107.317462:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3312:x1875503677030912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620107.317482:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620107.317507:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c20d0600/0xbb0e330328bbf18b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf184 expref: 19 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.317532:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620107.317631:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:937205a0-294a-4965-a8b3-aa80c7ce7507+18:3312:x1875503677030912:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (5410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620107.317638:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788620107.317665:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620107.317706:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:937205a0-294a-4965-a8b3-aa80c7ce7507:3312:1875503677030912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620107.318333:0:14479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3308:x1875503677030784:12345-0@lo:39:umount.0 Request processed in 6315us (6914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620107.318345:0:14479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:1.0:1788620107.318358:0:14479:0:(genops.c:885:class_export_put()) final put ffff9333a53c2800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788620107.318450:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333a53c2800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788620107.318541:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333a53c5800 for lustre-MDT0000 00000100:00080000:0.0:1788620107.320017:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333836dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788620107.320150:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677030784:0@lo:39:umount.0 00000100:00080000:3.0:1788620107.322463:0:17613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788620107.322474:0:17613:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788620107.322483:0:17613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788620107.323485:0:17613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323506:0:17613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323514:0:17613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323521:0:17613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323555:0:17613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620107.323563:0:17613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323570:0:17613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323576:0:17613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323583:0:17613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323598:0:17613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788620107.323624:0:17613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323631:0:17613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323638:0:17613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323643:0:17613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323671:0:17613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788620107.323677:0:17613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323684:0:17613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323691:0:17613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323698:0:17613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620107.323706:0:17613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788620107.323709:0:17613:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788620107.323752:0:17613:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788620107.323756:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788620107.323761:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620107.323768:0:17613:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788620107.323817:0:17613:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff933284df2000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788620107.323822:0:17613:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9332849a1800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788620107.323827:0:17613:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9333a53a8000) has exports, disconnecting them 00000020:00080000:3.0:1788620107.323833:0:17613:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff933284df2000), last request at 1788620104 00000020:00000080:3.0:1788620107.323841:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf2aa 00000100:00080000:3.0:1788620107.323869:0:17613:0:(import.c:65:import_set_state_nolock()) ffff933284df5800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788620107.323930:0:17613:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff933284df2000): rc 0 00000020:00000080:3.0:1788620107.323933:0:17613:0:(genops.c:885:class_export_put()) final put ffff933284df2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788620107.323942:0:17613:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9332849a1800), last request at 1788620104 00000020:00000080:3.0:1788620107.323945:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf23a 00000100:00080000:3.0:1788620107.323950:0:17613:0:(import.c:65:import_set_state_nolock()) ffff9332849a3000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788620107.323956:0:17613:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9332849a1800): rc 0 00000020:00000080:3.0:1788620107.323957:0:17613:0:(genops.c:885:class_export_put()) final put ffff9332849a1800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788620107.323966:0:17613:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbc7c01d1fae0 00000100:00080000:3.0:1788620107.323988:0:17613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788620107.323992:0:17613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:3.0:1788620107.324004:0:17613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1788620107.324183:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788620107.324192:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324200:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142200 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620107.324204:0:15949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324214:0:15949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620107.324222:0:15949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620107.324242:0:15949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620107.324245:0:15949:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788620107.324248:0:15949:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788620107.324298:0:15949:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324305:0:15949:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620107.324334:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324342:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc142200/0xbb0e330328bbf0ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf0f1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324356:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788620107.324359:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324364:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142400 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620107.324366:0:15949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324373:0:15949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620107.324379:0:15949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620107.324384:0:15949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620107.324386:0:15949:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788620107.324394:0:15949:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788620107.324409:0:15949:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324415:0:15949:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620107.324421:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324428:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc142400/0xbb0e330328bbf447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf44e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324442:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620107.324444:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324449:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620107.324452:0:15949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324458:0:15949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620107.324464:0:15949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620107.324469:0:15949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788620107.324471:0:15949:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788620107.324473:0:15949:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788620107.324484:0:15949:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324490:0:15949:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620107.324513:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324520:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc142c00/0xbb0e330328bbf4f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf4fd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324528:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620107.324531:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324537:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143600 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620107.324540:0:15949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324546:0:15949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620107.324552:0:15949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620107.324557:0:15949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620107.324560:0:15949:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788620107.324562:0:15949:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788620107.324573:0:15949:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324579:0:15949:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620107.324586:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324592:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc143600/0xbb0e330328bbf0dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf0e3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.324615:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620107.324617:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620107.324619:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620107.324641:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677031040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620107.324729:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620107.324813:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788620107.324819:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677031168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620107.324845:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620107.324877:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677031296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620107.324900:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620107.324916:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788620107.324922:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677031424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620107.324941:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620107.324970:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677031040 00000100:00100000:2.0:1788620107.324979:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677031040 00000100:00100000:2.0:1788620107.325021:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677031168 00000100:00100000:2.0:1788620107.325023:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677031168 00000100:00100000:2.0:1788620107.325033:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677031296 00000100:00100000:2.0:1788620107.325035:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677031296 00000100:00100000:2.0:1788620107.325045:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677031424 00000100:00100000:2.0:1788620107.325047:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677031424 00000100:00100000:2.0:1788620107.325143:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788620107.325151:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+21:3309:x1875503677031040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620107.325166:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620107.325192:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c20d1c00/0xbb0e330328bbf0f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf0ea expref: 21 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.325220:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620107.325262:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+20:3309:x1875503677031040:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620107.325269:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788620107.325289:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788620107.325295:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bafb0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+19:3309:x1875503677031168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620107.325303:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620107.325312:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813ce000/0xbb0e330328bbf44e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf447 expref: 19 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.325324:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620107.325345:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bafb0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+18:3309:x1875503677031168:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620107.325351:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788620107.325391:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620107.325397:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+17:3311:x1875503677031296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620107.325404:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620107.325413:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813cf600/0xbb0e330328bbf4fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf4f6 expref: 17 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.325425:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620107.325451:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+16:3311:x1875503677031296:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620107.325457:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620107.325471:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620107.325476:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+15:3311:x1875503677031424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620107.325490:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620107.325499:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c20d0e00/0xbb0e330328bbf0e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf0dc expref: 15 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620107.325511:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620107.325535:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:937205a0-294a-4965-a8b3-aa80c7ce7507+14:3311:x1875503677031424:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620107.325541:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620107.325587:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677031168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620107.325597:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677031040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620107.325624:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677031424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620107.325630:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677031296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620107.325746:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788620107.325760:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933284df2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788620107.325864:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9332849a1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788620107.325894:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933284df5800 for lustre-MDT0000 00000020:00000080:1.0:1788620107.325907:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9332849a3000 for lustre-MDT0000 00010000:00010000:0.0:1788620107.326353:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788620107.328022:0:17613:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788620107.328074:0:17613:0:(import.c:65:import_set_state_nolock()) ffff9333a53c0000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788620107.328105:0:17613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788620107.328110:0:17613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788620107.328131:0:17613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788620107.328204:0:17613:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788620107.328216:0:17613:0:(import.c:65:import_set_state_nolock()) ffff933385805800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788620107.328259:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9333a53a8000) has no exports 00000100:00100000:0.0:1788620107.328601:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677031552:0@lo:9:umount.0 00000100:00100000:0.0:1788620107.328687:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620107.328733:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677031680:0@lo:9:umount.0 00000100:00100000:0.0:1788620107.328757:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620107.328814:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677031552 00000100:00100000:0.0:1788620107.328823:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677031552 00000100:00100000:0.0:1788620107.328884:0:15165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677031680 00000100:00100000:0.0:1788620107.328887:0:15165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677031680 00000100:00100000:0.0:1788620107.328912:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788620107.328922:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875503677031552:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788620107.328952:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf2b8 00000100:00080000:0.0:1788620107.328962:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9333bbd77800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788620107.328995:0:15165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:0.0:1788620107.329222:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3308:x1875503677031552:12345-0@lo:9:umount.0 Request processed in 302us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620107.329231:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788620107.329247:0:15165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788620107.329253:0:15165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875503677031680:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788620107.329266:0:15165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf2bf 00000100:00080000:0.0:1788620107.329272:0:15165:0:(import.c:65:import_set_state_nolock()) ffff9333bbd72800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788620107.329294:0:15165:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788620107.329577:0:15165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3308:x1875503677031680:12345-0@lo:9:umount.0 Request processed in 323us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620107.329598:0:15165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788620107.329621:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788620107.329625:0:14475:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788620107.329636:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620107.329642:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788620107.329677:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933385805800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788620107.329683:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788620107.329685:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788620107.329688:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677031680:0@lo:9:umount.0 00000100:00080000:0.0:1788620107.329712:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333a53c0000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788620107.329723:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788620107.329725:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788620107.329727:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677031552:0@lo:9:umount.0 00000020:00080000:2.0:1788620107.347397:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9333a53a8000) has no exports 00000020:00000080:2.0:1788620107.396188:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf137 00000020:00000080:2.0:1788620107.396203:0:17613:0:(genops.c:885:class_export_put()) final put ffff9333c1e00800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788620107.396228:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788620107.396283:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333c1e00800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788620107.396590:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620107.396605:0:17613:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788620107.396611:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9333a53acd40) has no exports 00000020:00000080:0.0:1788620107.397887:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf130 00000020:00000080:0.0:1788620107.397905:0:17613:0:(genops.c:885:class_export_put()) final put ffff9333b94eb000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788620107.397992:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620107.398006:0:17613:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788620107.398010:0:17613:0:(genops.c:885:class_export_put()) final put ffff9333b94e8800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788620107.398013:0:17613:0:(genops.c:844:class_export_destroy()) destroying export ffff9333b94e8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788620107.398034:0:17613:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788620107.398056:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333b94eb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788620107.398209:0:17613:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333bd0e87e0 - data ffff93339c691000/ffff933284819000 00000020:01000000:0.0:1788620107.398372:0:17613:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333acf05120 - data ffff93339f16c0d8/ffff933389008c00 00000001:00000004:1.0:1788620107.430644:0:17613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000001:00100000:0.0:1788620107.552137:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788620107.552152:0:6720:0:(genops.c:885:class_export_put()) final put ffff9333bbd76000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788620107.552196:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eb10b78-2640-4d1c-bba9-c870a1e66de6 00000020:00000080:0.0:1788620107.552199:0:6720:0:(genops.c:885:class_export_put()) final put ffff9333bbd70800/6eb10b78-2640-4d1c-bba9-c870a1e66de6 00000020:00000080:3.0:1788620107.552499:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbd76000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788620107.552563:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbd70800/6eb10b78-2640-4d1c-bba9-c870a1e66de6 for lustre-OST0000 00000020:00000080:3.0:1788620107.552587:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bbd77800 for lustre-OST0000 00000020:00000080:3.0:1788620107.552592:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bbd74000 for lustre-OST0000 00000100:00080000:3.0:1788620107.554239:0:17613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788620107.554248:0:17613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:3.0:1788620107.554320:0:17613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788620107.554324:0:17613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788620107.561796:0:14501:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788620107.561829:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1788620107.561849:0:14501:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788620107.562894:0:17613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788620107.562902:0:17613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788620107.562925:0:17613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788620107.562928:0:17613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788620107.563342:0:14503:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788620107.563347:0:14503:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1788620107.563357:0:14503:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788620107.630670:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf0ff 00000020:00000080:0.0:1788620107.630686:0:17613:0:(genops.c:885:class_export_put()) final put ffff933382e2a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788620107.630734:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933382e2a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788620107.631710:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf114 00000020:00000080:1.0:1788620107.631721:0:17613:0:(genops.c:885:class_export_put()) final put ffff933393144800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788620107.631759:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788620107.631767:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788620107.631807:0:17613:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788620107.631813:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9333a53ab380) has no exports 00000020:00000080:0.0:1788620107.631820:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933393144800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788620107.632005:0:17613:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788620107.632015:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf161 00000020:00000080:1.0:1788620107.632020:0:17613:0:(genops.c:885:class_export_put()) final put ffff933386278000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788620107.632036:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788620107.632040:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788620107.632045:0:17613:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788620107.632048:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9333bd3419c0) has no exports 00000020:00000080:1.0:1788620107.632056:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf15a 00000020:00000080:1.0:1788620107.632060:0:17613:0:(genops.c:885:class_export_put()) final put ffff933385802000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788620107.632213:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933386278000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788620107.632220:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933385802000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788620107.632459:0:17613:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788620107.632464:0:17613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788620107.632470:0:17613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788620107.632477:0:17613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788620107.632480:0:17613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788620107.632524:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788620107.632531:0:17613:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788620107.632536:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf14c 00000020:00000080:1.0:1788620107.632541:0:17613:0:(genops.c:885:class_export_put()) final put ffff933385804800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788620107.632545:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788620107.632548:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788620107.632553:0:17613:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788620107.632555:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9333bd1d0000) has no exports 00000020:00000080:1.0:1788620107.632559:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf145 00000020:00000080:1.0:1788620107.632561:0:17613:0:(genops.c:885:class_export_put()) final put ffff9333a53c2000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788620107.632791:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933385805800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788620107.632799:0:13043:0:(genops.c:885:class_export_put()) final put ffff933385802800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788620107.632802:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933385802800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788620107.632807:0:13043:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788620107.632898:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933385804800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788620107.632902:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9333a53c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788620107.635434:0:17613:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788620107.635444:0:17613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788620107.635450:0:17613:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:1.0:1788620107.635461:0:17613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788620107.635478:0:17613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788620107.635539:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620107.635552:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333a53c0000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788620107.635553:0:17613:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788620107.635564:0:13043:0:(genops.c:885:class_export_put()) final put ffff9333a53c0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788620107.635567:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9333a53c0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788620107.635576:0:13043:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788620107.636867:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788620107.636883:0:17613:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788620107.636890:0:17613:0:(genops.c:885:class_export_put()) final put ffff933382e2e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788620107.636894:0:17613:0:(genops.c:844:class_export_destroy()) destroying export ffff933382e2e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788620107.636902:0:17613:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788620107.637068:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf11b 00000020:00000080:1.0:1788620107.637079:0:17613:0:(genops.c:885:class_export_put()) final put ffff933393142000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788620107.637104:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788620107.637110:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788620107.637116:0:17613:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788620107.637121:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9333a53a99c0) has no exports 00000020:00000080:1.0:1788620107.637145:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788620107.637149:0:17613:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788620107.637155:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf122 00000020:00000080:1.0:1788620107.637159:0:17613:0:(genops.c:885:class_export_put()) final put ffff933393142800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788620107.637169:0:17613:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933384eee800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788620107.637184:0:17613:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933384eee800 3 00000020:01000004:1.0:1788620107.637188:0:17613:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff933384eee800 from lustre-MDT0000 00000020:00000080:0.0:1788620107.637213:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933393142000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788620107.637219:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620107.637219:0:13043:0:(genops.c:885:class_export_put()) final put ffff933393143800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788620107.637222:0:17613:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788620107.637222:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933393143800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788620107.637225:0:17613:0:(genops.c:885:class_export_put()) final put ffff933382e28000/lustre-MDT0000_UUID 00000020:01000000:0.0:1788620107.637226:0:13043:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788620107.637228:0:17613:0:(genops.c:844:class_export_destroy()) destroying export ffff933382e28000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788620107.637236:0:17613:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788620107.637265:0:17613:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788620107.637270:0:17613:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788620107.637273:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788620107.637394:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933393142800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788620107.638379:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788620107.638391:0:17613:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788620107.638401:0:17613:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9333bc14b000 937205a0-294a-4965-a8b3-aa80c7ce7507 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788620107.638409:0:17613:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9333bd344d40) has exports, disconnecting them 00000020:00080000:1.0:1788620107.638430:0:17613:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9333bc14b000), last request at 1788620032 00000020:00000080:1.0:1788620107.638452:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf0c0 00000020:00010000:1.0:1788620107.638459:0:17613:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9333bc14b000: total 0 00000100:00080000:1.0:1788620107.638464:0:17613:0:(import.c:65:import_set_state_nolock()) ffff9333bc14b800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788620107.638489:0:17613:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9333bc14b000): rc 0 00000020:00080000:1.0:1788620107.638495:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9333bd344d40) has no exports 00000020:00010000:0.0:1788620107.638579:0:14468:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9333bc14b000: total 0 00010000:00010000:0.0:1788620107.638627:0:14468:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9333bc14b000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788620107.638663:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813cf800/0xbb0e330328bbf4e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf4da expref: 9 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620107.638700:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c2e00/0xbb0e330328bbf295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf28e expref: 8 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620107.638712:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbf225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf21e expref: 7 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620107.638724:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c20d1800/0xbb0e330328bbf0d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf0ce expref: 6 pid: 14473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620107.638737:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333813cfc00/0xbb0e330328bbf4ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf4e8 expref: 5 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620107.638752:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c20d0000/0xbb0e330328bbf1ed lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf1e6 expref: 4 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620107.638766:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c2200/0xbb0e330328bbf26b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf264 expref: 3 pid: 14474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620107.638798:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c1ed7c00/0xbb0e330328bbf1fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbb0e330328bbf1f4 expref: 2 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620107.638811:0:14468:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9333bc14b000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788620107.638825:0:14468:0:(genops.c:885:class_export_put()) final put ffff9333bc14b000/937205a0-294a-4965-a8b3-aa80c7ce7507 00010000:00010000:0.0:1788620107.638844:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620107.638846:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620107.638848:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788620107.638859:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bc14b000/937205a0-294a-4965-a8b3-aa80c7ce7507 for MGS 00000020:00000080:0.0:1788620107.638899:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bc14b800 for MGS 00000100:00100000:3.0:1788620107.642103:0:14472:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9333874bdc00:14472] 0 exiting: rc = 1 00000100:00100000:3.0:1788620107.642509:0:14473:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9333874bce00:14473] 1 exiting: rc = 0 00000100:00100000:0.0:1788620107.642672:0:14474:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff93339027de00:14474] 2 exiting: rc = 0 00000100:00100000:1.0:1788620107.642829:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642839:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642846:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642852:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642858:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642864:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642870:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642877:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642882:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642891:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642897:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642904:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642913:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642919:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642925:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642931:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642936:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642942:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642948:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642953:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642959:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642964:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642970:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642976:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642981:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642986:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642992:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.642998:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643013:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643019:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643026:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643032:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643038:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643045:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643050:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643056:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643062:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643068:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643073:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643079:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643084:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643090:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643095:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643101:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643107:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643113:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643118:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643124:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643136:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643142:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643148:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643154:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643160:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643166:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643183:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643190:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643196:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643202:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643207:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643223:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643229:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643236:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643242:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620107.643255:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788620107.643831:0:17613:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788620107.643836:0:17613:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788620107.653064:0:17613:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933387f6d240 - data ffff93339f1e4d80/ffff933387ef9000 00000020:01000000:1.0:1788620107.653591:0:17613:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333ad1f3e40 - data ffff93339f313af8/ffff9333bd0a5800 00000020:00000080:1.0:1788620107.655603:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf0ab 00000020:00000080:1.0:1788620107.655615:0:17613:0:(genops.c:885:class_export_put()) final put ffff933384ee8000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788620107.655646:0:17613:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933384eee800 from MGS, refs=2 00000020:01000004:1.0:1788620107.655650:0:17613:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933384eee800 2 00000020:01000004:1.0:1788620107.655653:0:17613:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff933384eee800 from MGS 00000020:00000080:1.0:1788620107.655685:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788620107.655694:0:17613:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788620107.655697:0:17613:0:(genops.c:885:class_export_put()) final put ffff933384ee9000/MGS 00000020:00000080:1.0:1788620107.655699:0:17613:0:(genops.c:844:class_export_destroy()) destroying export ffff933384ee9000/MGS for MGS 00000020:01000000:1.0:1788620107.655718:0:17613:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1788620107.655786:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933384ee8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788620107.656910:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788620107.656922:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788620107.656933:0:17613:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788620107.656941:0:17613:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9333bc0d6800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788620107.656949:0:17613:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff9333bd1d3380) has exports, disconnecting them 00000020:00080000:1.0:1788620107.656955:0:17613:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9333bc0d6800), last request at 1788620032 00000020:00000080:1.0:1788620107.656961:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf199 00000020:00080000:1.0:1788620107.656981:0:17613:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9333bc0d6800): rc 0 00000020:00000080:1.0:1788620107.656986:0:17613:0:(genops.c:885:class_export_put()) final put ffff9333bc0d6800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788620107.657385:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bc0d6800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788620107.685828:0:17613:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788620107.685839:0:17613:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788620107.685845:0:17613:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788620107.685854:0:17613:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788620107.686066:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620107.686075:0:17613:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788620107.686084:0:17613:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933384eee800 1 00000020:00000080:0.0:1788620107.686092:0:17613:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf09d 00000020:00000080:0.0:1788620107.686102:0:17613:0:(genops.c:885:class_export_put()) final put ffff933384eef800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788620107.686109:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788620107.686118:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620107.686123:0:17613:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788620107.686127:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9333bd343380) has no exports 00000020:00000080:3.0:1788620107.686206:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333836dc000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788620107.686216:0:496:0:(genops.c:885:class_export_put()) final put ffff9333bc0d4800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788620107.686219:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bc0d4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788620107.686233:0:496:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788620107.686355:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff933384eef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788620107.716168:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620107.716199:0:17613:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788620107.716206:0:17613:0:(genops.c:885:class_export_put()) final put ffff933384eee000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788620107.716816:0:17613:0:(genops.c:844:class_export_destroy()) destroying export ffff933384eee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788620107.716841:0:17613:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788620107.718039:0:17613:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff933384eed800 00000020:01000000:0.0:1788620107.718082:0:17613:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788620107.718088:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788620107.718095:0:17613:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788620107.718100:0:17613:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9333bd1d19c0) has no exports 00000100:00100000:0.0:1788620107.719814:0:14481:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff93328482e800:14481] 2 exiting: rc = 0 00000100:00100000:0.0:1788620107.720874:0:14479:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff93328439be00:14479] 0 exiting: rc = 1 00000100:00100000:3.0:1788620107.721642:0:14480:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff93328482fe00:14480] 1 exiting: rc = 0 00000100:00100000:2.0:1788620107.722949:0:16239:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff93338906e000:16239] 3 exiting: rc = 0 00000100:00100000:0.0:1788620107.723103:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723114:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723121:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723128:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723138:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723146:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723154:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723190:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723197:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723203:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723208:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723213:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723219:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723224:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723230:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723236:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723243:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723248:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723253:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723259:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723264:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723269:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723274:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723278:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723283:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723289:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723294:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723301:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723306:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723311:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723317:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723322:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723328:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723333:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723338:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723343:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723348:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723353:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723358:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723363:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723368:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723373:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723385:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723390:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723396:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723413:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723421:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723430:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723437:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723444:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723455:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723465:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723475:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723488:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723494:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723501:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723512:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723524:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723600:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723606:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723611:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723616:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723624:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.723629:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.736921:0:14482:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9333926b5200:14482] 0 exiting: rc = 1 00000100:00100000:3.0:1788620107.737026:0:14483:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff93328493dc00:14483] 1 exiting: rc = 0 00000100:00100000:0.0:1788620107.737128:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737137:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737145:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737150:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737155:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737161:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737167:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737184:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737190:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737195:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737305:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737314:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737318:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737335:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737350:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737356:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737360:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737365:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737371:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737376:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737382:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737387:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737393:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737398:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737403:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737408:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737414:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737419:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737424:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737429:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737435:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737440:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737446:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737452:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737457:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737462:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737467:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737473:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737480:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737486:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737493:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737498:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737504:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737509:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737514:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737520:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737526:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737531:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737546:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737551:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737557:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737562:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737567:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737572:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737577:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737584:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737590:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737595:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737601:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737608:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737614:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737619:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737637:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.737644:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.739900:0:14485:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9333afeb4e00:14485] 1 exiting: rc = 0 00000100:00100000:2.0:1788620107.740074:0:14484:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff93339601b400:14484] 0 exiting: rc = 1 00000100:00100000:0.0:1788620107.743416:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743426:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743432:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743438:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743457:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743464:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743469:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743475:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743481:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743486:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743492:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743498:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743506:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743512:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743517:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743523:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743544:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743552:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743557:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743578:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743584:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743601:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743610:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743617:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743623:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743629:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743635:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743640:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743647:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743653:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743660:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743666:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743687:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743694:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743700:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743706:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743713:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743718:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743724:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743730:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743736:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743742:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743749:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743755:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743804:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743812:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743817:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743823:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743829:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743835:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743851:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743858:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743865:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743870:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743882:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743888:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743910:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743917:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743922:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743927:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743933:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743939:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743944:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.743951:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.757020:0:14487:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff933284d84800:14487] 1 exiting: rc = 0 00000100:00100000:3.0:1788620107.757133:0:14486:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff933284d84e00:14486] 0 exiting: rc = 1 00000100:00100000:0.0:1788620107.764851:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764860:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764866:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764870:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764875:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764879:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764883:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764888:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764893:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764897:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764901:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764906:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764910:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764914:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764918:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764923:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764927:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764932:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764936:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764940:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764944:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764949:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764953:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764957:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764978:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764983:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764987:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764992:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.764996:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765001:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765006:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765010:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765014:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765018:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765023:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765028:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765033:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765037:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765042:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765046:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765051:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765056:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765060:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765064:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765068:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765073:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765077:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765081:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765086:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765091:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765095:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765100:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765105:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765109:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765113:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765117:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765122:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765126:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765131:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765143:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765147:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765152:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765156:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765161:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620107.765551:0:14488:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff933382843e00:14488] 0 exiting: rc = 1 00000100:00100000:3.0:1788620107.767269:0:14489:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff933382842200:14489] 1 exiting: rc = 0 00000100:00100000:3.0:1788620107.767400:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767406:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767411:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767416:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767422:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767426:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767431:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767435:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767440:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767462:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767467:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767472:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767478:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767482:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767487:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767492:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767497:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767502:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767507:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767511:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767515:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767520:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767524:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767528:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767532:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767536:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767541:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767545:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767550:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767554:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767560:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767576:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767581:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767586:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767590:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767595:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767600:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767605:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767609:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767615:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767620:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767624:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767638:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767643:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767654:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767659:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767665:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767670:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767675:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767680:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767685:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767689:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767694:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767699:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767705:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767711:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767716:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767720:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767725:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767729:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767734:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767738:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767743:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.767748:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768050:0:14491:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff93338f9dba00:14491] 1 exiting: rc = 0 00000100:00100000:3.0:1788620107.768133:0:14490:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9333bc088c00:14490] 0 exiting: rc = 1 00000100:00100000:3.0:1788620107.768191:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768196:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768201:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768206:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768212:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768218:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768223:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768228:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768233:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768238:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768243:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768248:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768253:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768266:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768271:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768276:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768281:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768286:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768290:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768296:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768302:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768307:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768311:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768316:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768321:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768325:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768329:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768334:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768338:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768343:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768347:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768352:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768357:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768362:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768366:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768371:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768377:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768382:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768388:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768392:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768397:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768402:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768408:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768413:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768418:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768423:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768428:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768432:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768444:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768449:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768453:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768458:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768463:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768468:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768473:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768477:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768481:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768486:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768490:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768494:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768498:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768503:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768507:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768512:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.768940:0:14493:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff93338cd29000:14493] 1 exiting: rc = 0 00000100:00100000:3.0:1788620107.769088:0:14494:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff93338cd28e00:14494] 2 exiting: rc = 0 00000100:00100000:2.0:1788620107.774053:0:14492:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff933284eb9000:14492] 0 exiting: rc = 1 00000100:00100000:3.0:1788620107.780662:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780672:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780679:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780684:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780690:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780710:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780735:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780742:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780748:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780754:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780758:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780763:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780783:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780791:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780798:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780804:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780810:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780830:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780836:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780842:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780847:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780852:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780859:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780865:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780871:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780877:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780882:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780888:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780894:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780900:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780920:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780927:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780932:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780937:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780943:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780949:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780954:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.780961:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.781310:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.781317:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.781328:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.781333:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782122:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782133:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782139:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782144:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782150:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782156:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782161:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782167:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782181:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782187:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782329:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782449:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782474:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782481:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782486:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782492:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782497:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782503:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782509:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782515:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782520:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620107.782525:0:17613:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788620107.792529:0:17613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620107.792541:0:17613:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788620107.792547:0:17613:0:(genops.c:885:class_export_put()) final put ffff9333bc06c800/MDS_uuid 00000020:00000080:3.0:1788620107.792551:0:17613:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bc06c800/MDS_uuid for MDS 00000020:01000000:3.0:1788620107.792556:0:17613:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788620107.792743:0:17613:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788620107.920974:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620108.935552:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788620109.027831:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788620109.027841:0:7647:0:(genops.c:885:class_export_put()) final put ffff9333bbd77000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788620109.027877:0:496:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbd77000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788620109.027936:0:496:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bbd72800 for lustre-OST0001 00010000:00010000:1.0:1788620109.962638:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620110.022951:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677031808:0@lo:400:kworker.0 00000400:00000100:1.0:1788620110.023029:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875503677031808 offset 0 length 224: 4 00000100:00100000:1.0:1788620110.023096:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620110.023104:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677031936:0@lo:400:kworker.0 00000400:00000100:1.0:1788620110.023128:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875503677031936 offset 0 length 224: 4 00000100:00100000:1.0:1788620110.023163:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503677032064:0@lo:400:kworker.0 00000400:00000100:1.0:1788620110.023230:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875503677032064 offset 0 length 224: 4 00000020:01000004:0.0:1788620110.682525:0:17767:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788620110.692401:0:17767:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788620110.692447:0:17767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620110.692461:0:17767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620110.692468:0:17767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620110.692475:0:17767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620110.692493:0:17767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788620110.692498:0:17767:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788620110.692520:0:17767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788620110.692530:0:17767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9333bd0aea00 x1875503677031936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620126 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620110.692544:0:17767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788620110.692550:0:17767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788620110.692575:0:17767:0:(import.c:65:import_set_state_nolock()) ffff9333bbd70000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788620110.692603:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677032192:0@lo:39:umount.0 00000400:00000100:0.0:1788620110.692665:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875503677032192 offset 0 length 224: 4 00010000:00010000:1.0:1788620110.692981:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620110.692988:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620110.692997:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7600 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620110.693001:0:15949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620110.693010:0:15949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620110.693018:0:15949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620110.693023:0:15949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788620110.693026:0:15949:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788620110.693028:0:15949:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788620110.693057:0:15949:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620110.693063:0:15949:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620110.693090:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620110.693098:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7600/0xbb0e330328bbf21e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbb0e330328bbf225 expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620110.693117:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620110.693119:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620110.693121:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620110.693144:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677031936:0@lo:400:kworker.0 00000100:00100000:1.0:1788620110.693180:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620110.693190:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677032320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620110.693234:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620110.693305:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677032320 00000100:00100000:2.0:1788620110.693313:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677032320 00000100:00100000:2.0:1788620110.693357:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620110.693364:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875503677032320:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788620110.693370:0:14465:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788620110 with bad export cookie 13478766823427797184 00000100:00100000:2.0:1788620110.707022:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875503677032320:12345-0@lo:103:ldlm_bl.0 Request processed in 13649us (13779us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788620110.707049:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788620110.707134:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788620110.707140:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9333bc069000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788620110.707145:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788620110.722661:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.112@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788620110.722667:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788620110.722676:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9333bd0ad500 x1875503677031808/t0(0) o400->MGC192.168.203.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788620126 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620110.724048:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9333bd0af800 x1875503677032320/t0(0) o103->MGC192.168.203.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788620126 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788620110.724060:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788620110.724063:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788620110.724064:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788620110.724068:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9333bc069000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788620110.724073:0:3311:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 435 00000100:00080000:1.0:1788620110.724084:0:3311:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff9333bc069000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620110.725593:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:937205a0-294a-4965-a8b3-aa80c7ce7507:3309:1875503677031808:0@lo:400:kworker.0 00000100:00100000:0.0:1788620110.725630:0:3311:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333908a4700 x1875503677032448/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788620110.725673:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:937205a0-294a-4965-a8b3-aa80c7ce7507:3311:1875503677032320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620110.725813:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:937205a0-294a-4965-a8b3-aa80c7ce7507:3308:1875503677032448:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788620110.725870:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875503677032448 offset 0 length 520: 4 00010000:00010000:1.0:1788620110.984801:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620112.008693:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620113.030978:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620114.055271:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620115.079174:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788620115.143314:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) 937205a0-294a-4965-a8b3-aa80c7ce7507->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788620115.143324:0:13043:0:(pinger.c:247:ptlrpc_pinger_process_import()) 937205a0-294a-4965-a8b3-aa80c7ce7507->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788620115.143433:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788620115.143452:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677032576:0@lo:400:kworker.0 00000400:00000100:2.0:1788620115.143503:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875503677032576 offset 0 length 224: 4 00010000:00010000:1.0:1788620116.103302:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620117.127199:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620118.151057:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620119.176653:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620120.199580:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620120.262955:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620110/real 1788620110] req@ffff9333908a4700 x1875503677032448/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788620120 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620120.262986:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9333908a4700 x1875503677032448/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788620120 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620120.262997:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620110/real 1788620110] req@ffff9333908a7800 x1875503677032192/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788620120 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620120.263011:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9333908a7800 x1875503677032192/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788620120 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788620120.263031:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333bc069000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620120.263057:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788620120.263061:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:937205a0-294a-4965-a8b3-aa80c7ce7507:3308:1875503677032448:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1788620120.263067:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333bbd70000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788620120.263091:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677032192:0@lo:39:umount.0 00000100:00080000:0.0:1788620120.263231:0:17767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788620120.263235:0:17767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788620120.263241:0:17767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788620120.264401:0:17767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620120.264419:0:17767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620120.264427:0:17767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620120.264434:0:17767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620120.264462:0:17767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620120.264469:0:17767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620120.264477:0:17767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620120.264483:0:17767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620120.264506:0:17767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620120.264531:0:17767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788620120.264536:0:17767:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788620120.264557:0:17767:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788620120.264561:0:17767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788620120.264566:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00080000:3.0:1788620120.264825:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) 937205a0-294a-4965-a8b3-aa80c7ce7507->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788620120.264831:0:13043:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788620120.264834:0:13043:0:(import.c:65:import_set_state_nolock()) ffff9333bc069000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620120.264841:0:13043:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 513 00000100:00080000:3.0:1788620120.264846:0:13043:0:(import.c:630:import_select_connection()) MGC192.168.203.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788620120.264850:0:13043:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff9333bc069000 using connection 192.168.203.112@tcp/0@lo 00010000:00010000:2.0:1788620120.264867:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620120.264875:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620120.264878:0:13043:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933387038a80 x1875503677032704/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1788620120.264882:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3c00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620120.264886:0:15949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620120.264895:0:15949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620120.264903:0:15949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620120.264908:0:15949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788620120.264911:0:15949:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788620120.264913:0:15949:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788620120.264925:0:15949:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9333bc069000 00010000:00010000:2.0:1788620120.264928:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620120.264935:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf1f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf1fb expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620120.264949:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788620120.264956:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677032832:0@lo:400:kworker.0 00010000:00010000:2.0:1788620120.264959:0:15949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620120.264965:0:15949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b30a00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620120.264967:0:15949:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620120.264974:0:15949:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620120.264979:0:15949:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620120.264983:0:15949:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788620120.264985:0:15949:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788620120.264987:0:15949:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788620120.264992:0:15949:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9333bc069000 00010000:00010000:2.0:1788620120.264994:0:15949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620120.264999:0:15949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333b8b30a00/0xbb0e330328bbf4e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf4ef expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620120.265007:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620120.265009:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788620120.265011:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875503677032832 offset 0 length 224: 4 00010000:00010000:2.0:1788620120.265011:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788620120.266287:0:17767:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788620120.266293:0:17767:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9332843b99c0) has no exports 00000020:00080000:0.0:1788620120.266323:0:17767:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9332843b99c0) has no exports 00010000:00010000:1.0:1788620120.268007:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620120.268032:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:937205a0-294a-4965-a8b3-aa80c7ce7507:3308:1875503677032704:0@lo:250:kworker.0 00000400:00000100:1.0:1788620120.268095:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875503677032704 offset 0 length 520: 4 00000020:01000000:0.0:1788620120.272524:0:17767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933387f6d780 - data ffff9333b8eac5e8/ffff933385936c00 00000020:01000000:0.0:1788620120.272920:0:17767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333bba2f480 - data ffff93339c687d80/ffff9333bc44cc00 00100000:10000000:0.0:1788620120.294636:0:17767:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788620120.347347:0:17767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf209 00000020:00000080:3.0:1788620120.347357:0:17767:0:(genops.c:885:class_export_put()) final put ffff933284df0800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788620120.347378:0:17767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933387e54000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788620120.347381:0:17767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933387e54000 2 00000020:01000004:3.0:1788620120.347385:0:17767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff933387e54000 from lustre-OST0000 00000020:00000080:3.0:1788620120.347408:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620120.347417:0:17767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788620120.347420:0:17767:0:(genops.c:885:class_export_put()) final put ffff933390dfc800/lustre-OST0000_UUID 00000020:00000080:3.0:1788620120.347422:0:17767:0:(genops.c:844:class_export_destroy()) destroying export ffff933390dfc800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788620120.347429:0:17767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788620120.347495:0:17767:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788620120.347499:0:17767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788620120.347503:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620120.347507:0:17767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788620120.347514:0:17767:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9333bbd76800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788620120.347520:0:17767:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff93328485cd40) has exports, disconnecting them 00000020:00080000:3.0:1788620120.347525:0:17767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9333bbd76800), last request at 1788620045 00000020:00000080:3.0:1788620120.347529:0:17767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf233 00000020:00080000:3.0:1788620120.347841:0:17767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9333bbd76800): rc 0 00000020:00000080:3.0:1788620120.347847:0:17767:0:(genops.c:885:class_export_put()) final put ffff9333bbd76800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788620120.348279:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933284df0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788620120.348291:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbd76800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788620120.394963:0:17767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788620120.394971:0:17767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788620120.394991:0:17767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788620120.394998:0:17767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788620120.395210:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788620120.395218:0:17767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788620120.395227:0:17767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933387e54000 1 00000020:00000080:2.0:1788620120.395234:0:17767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf1d8 00000020:00000080:2.0:1788620120.395242:0:17767:0:(genops.c:885:class_export_put()) final put ffff933385800800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788620120.395247:0:17767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788620120.395252:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620120.395256:0:17767:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788620120.395259:0:17767:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9332849cb380) has no exports 00000020:00000080:0.0:1788620120.395324:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bbd70000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788620120.395331:0:13043:0:(genops.c:885:class_export_put()) final put ffff9333bbd71000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788620120.395335:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bbd71000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788620120.395343:0:13043:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788620120.395392:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933385800800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788620120.408428:0:17767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788620120.408444:0:17767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788620120.408450:0:17767:0:(genops.c:885:class_export_put()) final put ffff933387e51000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788620120.408454:0:17767:0:(genops.c:844:class_export_destroy()) destroying export ffff933387e51000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788620120.408461:0:17767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788620120.408601:0:17767:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff933387e56800 00000020:02000400:0.0:1788620120.408801:0:17767:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788620121.225928:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620122.258925:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788620123.091411:0:17919:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788620123.107161:0:17919:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788620123.107257:0:17919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620123.107273:0:17919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620123.107280:0:17919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620123.107302:0:17919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620123.107326:0:17919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788620123.107331:0:17919:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788620123.107355:0:17919:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788620123.107368:0:17919:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9333bd0aed80 x1875503677032064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620126 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620123.107386:0:17919:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93338703aa00 x1875503677032576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620131 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620123.107405:0:17919:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff93338703b800 x1875503677032832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620136 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620123.107413:0:17919:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788620123.107420:0:17919:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788620123.107444:0:17919:0:(import.c:65:import_set_state_nolock()) ffff933284ead800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788620123.107453:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677032832:0@lo:400:kworker.0 00000100:00100000:2.0:1788620123.107463:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677032576:0@lo:400:kworker.0 00010000:00010000:1.0:1788620123.107559:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620123.107566:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620123.107575:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3800 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620123.107578:0:14468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620123.107587:0:14468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620123.107595:0:14468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620123.107600:0:14468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788620123.107603:0:14468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788620123.107605:0:14468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788620123.107618:0:14468:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9333bc069000 00010000:00010000:1.0:1788620123.107621:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620123.107628:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbf28e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf295 expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620123.107639:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620123.107641:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620123.107642:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620123.107658:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677032960:0@lo:39:umount.0 00000400:00000100:1.0:1788620123.107704:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875503677032960 offset 0 length 224: 4 00000100:00100000:0.0:1788620123.107991:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875503677032064:0@lo:400:kworker.0 00010000:00010000:1.0:1788620123.271760:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620124.295068:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620125.319020:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788620125.384504:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) 937205a0-294a-4965-a8b3-aa80c7ce7507->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788620125.384514:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) 937205a0-294a-4965-a8b3-aa80c7ce7507->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788620126.343529:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620127.367906:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620128.391061:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620129.415110:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620130.439128:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788620130.503244:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) 937205a0-294a-4965-a8b3-aa80c7ce7507->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788620130.503255:0:496:0:(pinger.c:247:ptlrpc_pinger_process_import()) 937205a0-294a-4965-a8b3-aa80c7ce7507->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788620131.463053:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620132.487251:0:14467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620133.318905:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620123/real 1788620123] req@ffff93338703a680 x1875503677032960/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788620133 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620133.318939:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93338703a680 x1875503677032960/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788620133 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788620133.318958:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933284ead800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788620133.318974:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677032960:0@lo:39:umount.0 00000100:00080000:3.0:1788620133.320939:0:17919:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788620133.320946:0:17919:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788620133.320953:0:17919:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788620133.327461:0:17919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620133.327481:0:17919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620133.327489:0:17919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620133.327513:0:17919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620133.327542:0:17919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620133.327549:0:17919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620133.327556:0:17919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620133.327563:0:17919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620133.327569:0:17919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620133.327585:0:17919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788620133.327589:0:17919:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788620133.327610:0:17919:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788620133.327614:0:17919:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788620133.327618:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620133.327622:0:17919:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788620133.327627:0:17919:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9332843b8000) has no exports 00000020:00080000:3.0:1788620133.327649:0:17919:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9332843b8000) has no exports 00010000:00010000:1.0:1788620133.327883:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788620133.327892:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620133.327902:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6800 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620133.327906:0:14468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620133.327916:0:14468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620133.327924:0:14468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620133.327930:0:14468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788620133.327933:0:14468:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788620133.327935:0:14468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788620133.327951:0:14468:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9333bc069000 00010000:00010000:1.0:1788620133.327955:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620133.327974:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf26b expref: -99 pid: 15877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620133.327989:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620133.328005:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620133.328012:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333b8b31000 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620133.328015:0:14468:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620133.328022:0:14468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620133.328030:0:14468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620133.328035:0:14468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788620133.328037:0:14468:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788620133.328039:0:14468:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788620133.328046:0:14468:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9333bc069000 00010000:00010000:1.0:1788620133.328049:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620133.328055:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333b8b31000/0xbb0e330328bbf4da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf4e1 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620133.328069:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620133.328072:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620133.328079:0:14468:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620133.328137:0:15949:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788620133.329620:0:17919:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff933387f6d540 - data ffff93339f1b2798/ffff933287066800 00000020:01000000:3.0:1788620133.329765:0:17919:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9333bba2f240 - data ffff93339c7e60d8/ffff9333bc44d800 00100000:10000000:2.0:1788620133.340155:0:17919:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788620133.376387:0:17919:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf279 00000020:00000080:3.0:1788620133.376403:0:17919:0:(genops.c:885:class_export_put()) final put ffff9333bd2c2000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788620133.376415:0:17919:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933390dfb000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788620133.376429:0:17919:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933390dfb000 2 00000020:01000004:3.0:1788620133.376433:0:17919:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff933390dfb000 from lustre-OST0001 00000020:00000080:3.0:1788620133.376457:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620133.376468:0:17919:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788620133.376472:0:17919:0:(genops.c:885:class_export_put()) final put ffff933284df3000/lustre-OST0001_UUID 00000020:00000080:3.0:1788620133.376475:0:17919:0:(genops.c:844:class_export_destroy()) destroying export ffff933284df3000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788620133.376483:0:17919:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1788620133.376553:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bd2c2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788620133.380330:0:17919:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 937205a0-294a-4965-a8b3-aa80c7ce7507->MGS 00010000:00010000:3.0:1788620133.380350:0:17919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf1ed expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620133.380371:0:17919:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf1ed expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620133.380379:0:17919:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788620133.380381:0:17919:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788620133.380385:0:17919:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788620133.380400:0:17919:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9333bc069000 00010000:00010000:3.0:1788620133.380404:0:17919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf1e6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf1ed expref: -99 pid: 15161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620133.380420:0:17919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620133.380427:0:17919:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620133.380448:0:17919:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788620133.380452:0:17919:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788620133.380454:0:17919:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788620133.380465:0:17919:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9333bc069000 00010000:00010000:3.0:1788620133.380468:0:17919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc143200/0xbb0e330328bbf0ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbb0e330328bbf0d5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788620133.380498:0:17919:0:(import.c:65:import_set_state_nolock()) ffff9333bc069000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788620133.380513:0:17919:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788620133.380516:0:17919:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788620133.380517:0:17919:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788620133.380523:0:17919:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788620133.380548:0:17919:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff933387038a80 x1875503677032704/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788620135 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788620133.380563:0:17919:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788620133.380566:0:17919:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788620133.380637:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:937205a0-294a-4965-a8b3-aa80c7ce7507:3308:1875503677032704:0@lo:250:kworker.0 10000000:01000000:3.0:1788620133.380699:0:17919:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788620133.380706:0:17919:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf0b9 00000020:00000080:3.0:1788620133.380711:0:17919:0:(genops.c:885:class_export_put()) final put ffff9333bc06a800/937205a0-294a-4965-a8b3-aa80c7ce7507 00000020:01000000:3.0:1788620133.380723:0:17919:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.112@tcp (flags='') 00000020:00000080:3.0:1788620133.380727:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620133.380733:0:17919:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.112@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788620133.380736:0:17919:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9333bd1d4d40) has no exports 00000020:00000080:1.0:1788620133.380796:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bc06a800/937205a0-294a-4965-a8b3-aa80c7ce7507 for MGC192.168.203.112@tcp 10000000:01000000:0.0:1788620133.380860:0:14476:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788620133.380978:0:17919:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.112@tcp: client import never connected 00000100:00080000:3.0:1788620133.380980:0:17919:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788620133.380982:0:17919:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788620133.380983:0:17919:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788620133.380985:0:17919:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788620133.381029:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788620133.381034:0:17919:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.112@tcp (uuid 937205a0-294a-4965-a8b3-aa80c7ce7507) 00000020:01000000:3.0:1788620133.381038:0:17919:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788620133.381041:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788620133.381044:0:17919:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788620133.381047:0:17919:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff933286c98800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788620133.381051:0:17919:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff9332849ccd40) has exports, disconnecting them 00000020:00080000:3.0:1788620133.381054:0:17919:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff933286c98800), last request at 1788620057 00000020:00000080:3.0:1788620133.381057:0:17919:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf2a3 00000020:00080000:3.0:1788620133.381070:0:17919:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff933286c98800): rc 0 00000020:00000080:3.0:1788620133.381073:0:17919:0:(genops.c:885:class_export_put()) final put ffff933286c98800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788620133.381439:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9333bc069000 for MGC192.168.203.112@tcp 00000020:00000080:1.0:1788620133.381447:0:13043:0:(genops.c:885:class_export_put()) final put ffff9333bc06b800/937205a0-294a-4965-a8b3-aa80c7ce7507 00000020:00000080:1.0:1788620133.381450:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9333bc06b800/937205a0-294a-4965-a8b3-aa80c7ce7507 for MGC192.168.203.112@tcp 00000020:01000000:1.0:1788620133.381454:0:13043:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.112@tcp (937205a0-294a-4965-a8b3-aa80c7ce7507) 00000020:00000080:1.0:1788620133.381692:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff933286c98800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788620133.382862:0:17919:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788620133.382867:0:17919:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788620133.382871:0:17919:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788620133.382877:0:17919:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788620133.382919:0:13043:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff933284ead800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788620133.382952:0:14467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788620133.383125:0:14468:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788620133.383243:0:15949:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788620133.383589:0:16595:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9333bb913800:16595] 2 exiting: rc = 0 00000100:00100000:0.0:1788620133.383648:0:14462:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9332848c8000:14462] 0 exiting: rc = 1 00000100:00100000:1.0:1788620133.383719:0:14463:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9332848c9c00:14463] 1 exiting: rc = 0 00000100:00100000:2.0:1788620133.383831:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788620133.384105:0:14466:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9333bc189a00:14466] 2 exiting: rc = 0 00000100:00100000:0.0:1788620133.384159:0:14464:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff933385d08a00:14464] 0 exiting: rc = 1 00000100:00100000:2.0:1788620133.384230:0:14465:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff93338f911600:14465] 1 exiting: rc = 0 00000100:00100000:2.0:1788620133.384275:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384282:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384289:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384294:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384300:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384305:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384310:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384316:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384321:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384326:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384331:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384337:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384347:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384353:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384357:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384363:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384369:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384374:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384398:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384458:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384465:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384471:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384476:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384481:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384486:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384492:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384501:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384545:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384569:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384575:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384581:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384586:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384591:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384606:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384611:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384617:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384623:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384628:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384633:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384638:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384643:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384648:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384654:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384659:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384665:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384670:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384676:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384727:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384734:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384739:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384744:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384749:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384754:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384759:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384764:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384882:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384889:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384894:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384899:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384904:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384910:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384914:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384920:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.384925:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788620133.385720:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788620133.385729:0:17919:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788620133.385735:0:17919:0:(genops.c:885:class_export_put()) final put ffff933284eaa800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788620133.385739:0:17919:0:(genops.c:844:class_export_destroy()) destroying export ffff933284eaa800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788620133.385750:0:17919:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788620133.385866:0:17919:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933390dfb000 1 00000020:00000080:2.0:1788620133.385873:0:17919:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xbb0e330328bbf25d 00000020:00000080:2.0:1788620133.385880:0:17919:0:(genops.c:885:class_export_put()) final put ffff9332849a3800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788620133.385925:0:17919:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788620133.385929:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620133.385934:0:17919:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788620133.385937:0:17919:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9332870a19c0) has no exports 00000020:00000080:1.0:1788620133.386331:0:13043:0:(genops.c:844:class_export_destroy()) destroying export ffff9332849a3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788620133.403308:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788620133.403326:0:17919:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788620133.403332:0:17919:0:(genops.c:885:class_export_put()) final put ffff9332849a2800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788620133.403336:0:17919:0:(genops.c:844:class_export_destroy()) destroying export ffff9332849a2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788620133.403343:0:17919:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788620133.403547:0:17919:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff933387e53000 00000020:01000000:2.0:1788620133.403569:0:17919:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788620133.403573:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788620133.403577:0:17919:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788620133.403581:0:17919:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9333bd340000) has no exports 00000020:00000080:2.0:1788620133.403606:0:17919:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788620133.403612:0:17919:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788620133.403615:0:17919:0:(genops.c:885:class_export_put()) final put ffff933385801000/OSS_uuid 00000020:00000080:2.0:1788620133.403617:0:17919:0:(genops.c:844:class_export_destroy()) destroying export ffff933385801000/OSS_uuid for OSS 00000020:01000000:2.0:1788620133.403621:0:17919:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788620133.403819:0:15166:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9333981d7c00:15166] 2 exiting: rc = 0 00000100:00100000:1.0:1788620133.403921:0:15945:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9333bc583400:15945] 3 exiting: rc = 0 00000100:00100000:1.0:1788620133.403975:0:15165:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9333981d6a00:15165] 1 exiting: rc = 0 00000100:00100000:2.0:1788620133.405915:0:15164:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9333981d7000:15164] 0 exiting: rc = 1 00000100:00100000:1.0:1788620133.406144:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406154:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406160:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406166:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406170:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406176:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406181:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406186:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406191:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406197:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406202:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406207:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406213:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406234:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406239:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406245:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406253:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406258:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406266:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406271:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406276:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406281:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406286:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406292:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406298:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406306:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406312:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406317:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406323:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406328:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406334:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406340:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406345:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406351:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406357:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406363:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406369:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406375:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406380:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406385:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406391:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406397:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406401:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406407:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406411:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406417:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406422:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406431:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406445:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406451:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406457:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406463:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406469:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406476:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406482:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406488:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406493:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406498:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406503:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406508:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406513:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406518:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406535:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.406542:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.407387:0:15167:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff933284dcf600:15167] 0 exiting: rc = 1 00000100:00100000:2.0:1788620133.407596:0:15168:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9333a53d4000:15168] 1 exiting: rc = 0 00000100:00100000:1.0:1788620133.408255:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408264:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408269:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408275:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408280:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408324:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408330:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408334:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408339:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408343:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408348:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408352:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408357:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408363:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408368:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408373:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408378:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408382:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408400:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408405:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408410:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408415:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408420:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408425:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408430:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408434:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408439:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408443:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408448:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408453:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408458:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408464:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408469:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408474:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408479:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408483:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408488:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408493:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408498:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408503:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408507:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408511:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408516:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408521:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1788620133.408669:0:14475:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788620133.408917:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408923:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408928:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408934:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408942:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408950:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408957:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408963:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408966:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408976:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408980:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408984:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408987:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.408990:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.409003:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.409010:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.409019:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.409025:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.409030:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.409035:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410165:0:15170:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff933284dce800:15170] 1 exiting: rc = 0 00000100:00100000:2.0:1788620133.410352:0:16708:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9332848fbc00:16708] 3 exiting: rc = 0 00000100:00100000:3.0:1788620133.410367:0:15169:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff933284dcf400:15169] 0 exiting: rc = 1 00000100:00100000:0.0:1788620133.410516:0:15171:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff933284dcea00:15171] 2 exiting: rc = 0 00000100:00100000:0.0:1788620133.410833:0:16710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff9333bc32aa00:16710] 4 exiting: rc = 0 00000100:00100000:2.0:1788620133.410890:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410905:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410912:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410917:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410923:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410940:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410945:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410950:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410955:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410960:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410966:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410971:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410977:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410983:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.410989:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411009:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411015:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411021:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411026:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411031:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411037:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411042:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411058:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411064:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411070:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411080:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411086:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411092:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411098:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411103:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411108:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411116:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411121:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411128:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411134:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411140:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411146:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411151:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411157:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411163:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411175:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411181:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411187:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411192:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411198:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411204:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411224:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411232:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411238:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411244:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411250:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411256:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411261:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411267:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411274:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411282:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411288:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411294:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411300:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411308:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411313:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411319:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411325:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.411338:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788620133.417228:0:15173:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff933284dcfc00:15173] 1 exiting: rc = 0 00000100:00100000:0.0:1788620133.417327:0:15172:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff933284dcfa00:15172] 0 exiting: rc = 1 00000100:00100000:2.0:1788620133.417378:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417386:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417392:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417398:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417404:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417410:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417415:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417421:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417426:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417431:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417436:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417458:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417463:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417469:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417474:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417480:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417485:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417490:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417495:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417499:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417504:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417511:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417516:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417520:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417525:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417530:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417539:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417546:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417550:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417556:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417577:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417584:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417589:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417594:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417599:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417603:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417608:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417613:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417618:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417623:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417628:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417634:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417639:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417644:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417649:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417654:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417667:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417672:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417679:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417685:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417690:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417696:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417701:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417706:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417712:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417722:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417728:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417733:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417738:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417743:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417747:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417753:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417757:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788620133.417763:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.418939:0:15174:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff93338120be00:15174] 0 exiting: rc = 1 00000100:00100000:3.0:1788620133.419088:0:15175:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9333bc3b1800:15175] 1 exiting: rc = 0 00000100:00100000:1.0:1788620133.419181:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419189:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419195:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419202:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419205:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419214:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419221:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419226:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419259:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419267:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419273:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419278:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419284:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419290:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419294:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419298:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419303:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419306:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419311:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419316:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419341:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419350:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419355:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419374:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419380:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419386:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419392:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419398:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419404:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419411:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419418:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419424:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419444:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419452:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419459:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419465:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419471:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419477:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419483:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419489:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419494:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419499:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419505:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419511:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419549:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419557:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419565:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419581:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419589:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419595:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419600:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419606:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419616:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419622:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419628:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419633:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419654:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419661:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419672:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419677:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419683:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419690:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419699:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788620133.419710:0:17919:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788620133.425751:0:17919:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788620150.534760:0:18537:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788620159.710900:0:18997:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788620159.710904:0:18997:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788620159.711016:0:18997:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff933390d8c000 00000020:01000004:3.0:1788620159.711029:0:18997:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788620159.711036:0:18997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788620159.711048:0:18997:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9332870a0000) 00000020:00000080:3.0:1788620159.711058:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788620159.728096:0:18997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788620159.730483:0:18997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1788620159.730712:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 357: rc = 0 00100000:10000000:3.0:1788620159.730955:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 357: rc = 0 00100000:10000000:3.0:1788620159.731055:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 357: rc = 0 00100000:10000000:3.0:1788620159.731274:0:18997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788620159.731317:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 357: rc = 0 00100000:10000000:3.0:1788620159.731396:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 357: rc = 0 00100000:10000000:3.0:1788620159.731488:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 357: rc = 0 00100000:10000000:3.0:1788620159.731968:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 359: rc = 0 00100000:10000000:3.0:1788620159.735318:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:3.0:1788620159.735415:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:3.0:1788620159.736251:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788620159.736496:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:3.0:1788620159.737268:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:3.0:1788620159.737473:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:3.0:1788620159.737655:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788620159.738212:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788620159.738496:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788620159.738669:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 645: rc = 0 00100000:10000000:3.0:1788620159.739027:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788620159.739538:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 645: rc = 0 00100000:10000000:3.0:1788620159.739739:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788620159.740172:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 645: rc = 0 00100000:10000000:3.0:1788620159.740633:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 528: rc = 0 00100000:10000000:3.0:1788620159.740942:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 528: rc = 0 00100000:10000000:3.0:1788620159.741205:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 528: rc = 0 00100000:10000000:3.0:1788620159.741459:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 528: rc = 0 00100000:10000000:3.0:1788620159.741704:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 528: rc = 0 00100000:10000000:3.0:1788620159.742030:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 528: rc = 0 00100000:10000000:3.0:1788620159.742285:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 528: rc = 0 00100000:10000000:3.0:1788620159.742532:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 528: rc = 0 00100000:10000000:3.0:1788620159.742798:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 528: rc = 0 00100000:10000000:2.0:1788620159.747577:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 528: rc = 0 00100000:10000000:2.0:1788620159.749156:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 528: rc = 0 00100000:10000000:2.0:1788620159.749586:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 528: rc = 0 00100000:10000000:2.0:1788620159.750329:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 528: rc = 0 00100000:10000000:2.0:1788620159.750589:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 528: rc = 0 00100000:10000000:3.0:1788620159.753635:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 528: rc = 0 00100000:10000000:3.0:1788620159.753988:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 528: rc = 0 00100000:10000000:1.0:1788620159.754973:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 528: rc = 0 00100000:10000000:1.0:1788620159.755233:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 528: rc = 0 00100000:10000000:1.0:1788620159.755451:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 528: rc = 0 00100000:10000000:1.0:1788620159.755657:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 528: rc = 0 00100000:10000000:1.0:1788620159.755950:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 528: rc = 0 00100000:10000000:1.0:1788620159.756174:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 528: rc = 0 00100000:10000000:1.0:1788620159.756392:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 528: rc = 0 00100000:10000000:1.0:1788620159.756601:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 528: rc = 0 00100000:10000000:1.0:1788620159.756870:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 528: rc = 0 00100000:10000000:1.0:1788620159.757089:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 528: rc = 0 00100000:10000000:1.0:1788620159.757300:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 528: rc = 0 00100000:10000000:1.0:1788620159.757507:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 528: rc = 0 00100000:10000000:1.0:1788620159.757727:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 528: rc = 0 00100000:10000000:1.0:1788620159.759725:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 528: rc = 0 00100000:10000000:1.0:1788620159.760048:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 528: rc = 0 00100000:10000000:1.0:1788620159.760676:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 528: rc = 0 00100000:10000000:1.0:1788620159.761427:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 502: rc = 0 00100000:10000000:1.0:1788620159.762339:0:18997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788620159.762527:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:1.0:1788620159.763179:0:18997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788620159.763257:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:1.0:1788620159.763510:0:18997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788620159.763582:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:1.0:1788620159.764253:0:18997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1788620159.764327:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 516: rc = 0 00100000:10000000:1.0:1788620159.764579:0:18997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1788620159.764974:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 516: rc = 0 00100000:10000000:1.0:1788620159.765166:0:18997:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1788620159.765239:0:18997:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 516: rc = 0 00000020:00000080:1.0:1788620159.765579:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788620159.765587:0:18997:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788620159.765596:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf796 00000020:01000004:1.0:1788620159.765604:0:18997:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788620159.765608:0:18997:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788620159.765612:0:18997:0:(tgt_mount.c:101:server_register_mount()) register mount ffff933390d8c000 from MGS 00000020:01000004:1.0:1788620159.765616:0:18997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788620159.765626:0:18997:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9332848599c0) 00000020:00000080:1.0:1788620159.765636:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788620159.765979:0:18997:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933390d8c000 from MGS, refs=2 00080000:01000000:1.0:1788620159.765984:0:18997:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788620159.765990:0:18997:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf7a4 00000100:00100000:1.0:1788620159.766082:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788620159.766214:0:18997:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788620159.766220:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788620159.767134:0:18997:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788620159.767143:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788620159.770599:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620159.771405:0:18997:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788620159.771415:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788620159.772268:0:18997:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788620159.772276:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788620159.772644:0:18997:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788620159.772655:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788620159.773444:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620159.773448:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620159.773450:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620159.773806:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620159.773808:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620159.773818:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620159.774528:0:18997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788620159.786019:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788620159.792959:0:18997:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788620159.792978:0:18997:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788620159.792981:0:18997:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788620159.796267:0:19007:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788620159.796470:0:18997:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788620159.796584:0:18997:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788620159.797095:0:18997:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788620159.797661:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620159.797871:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788620159.797878:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788620159.799166:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788620159.799176:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788620159.799510:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788620159.799516:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788620159.800487:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788620159.800507:0:18997:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.112@tcp' 00000020:01000004:0.0:1788620159.800509:0:18997:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788620159.800537:0:18997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.112@tcp (typ=mgc) 00000020:00000080:0.0:1788620159.800548:0:18997:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.112@tcp (ffff9332843bb380) 00000020:00000080:0.0:1788620159.800562:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788620159.800633:0:18997:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333bbfab800@MGC192.168.203.112@tcp: add connection 192.168.203.112@tcp at head 00000100:00080000:3.0:1788620159.800868:0:19011:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1788620159.800921:0:18997:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.112@tcp-0 is initialized 00000040:01000000:0.0:1788620159.800935:0:18997:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788620159.815284:0:19012:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788620159.815897:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.112@tcp (uuid 7b50befa-471f-4f69-9917-f69b46ba475e) 00000020:00000080:0.0:1788620159.815923:0:18997:0:(genops.c:1385:class_connect()) connect: client 7b50befa-471f-4f69-9917-f69b46ba475e, cookie 0xbb0e330328bbf7b2 00000100:00080000:0.0:1788620159.815938:0:18997:0:(import.c:545:import_select_connection()) MGC192.168.203.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788620159.815945:0:18997:0:(import.c:665:import_select_connection()) MGC192.168.203.112@tcp: import ffff9333bbfab800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788620159.815981:0:18997:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333908a5180 x1875503677033088/t0(0) o250->MGC192.168.203.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788620159.816004:0:18997:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7b50befa-471f-4f69-9917-f69b46ba475e->MGS 00000020:01000004:0.0:1788620159.816019:0:18997:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788620159.816023:0:18997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788620159.816036:0:18997:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9332843bcd40) 00000020:00000080:0.0:1788620159.816047:0:18997:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788620159.816338:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b50befa-471f-4f69-9917-f69b46ba475e:3308:1875503677033088:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788620159.816401:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620159.824917:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677033088 00000100:00100000:2.0:1788620159.824940:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677033088 00000100:00100000:2.0:1788620159.824982:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620159.824991:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328493b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1875503677033088:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788620159.825018:0:19008:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7b50befa-471f-4f69-9917-f69b46ba475e@0@lo t0 exp 0000000000000000 cur 562 last 0 00000020:00000080:2.0:1788620159.825050:0:19008:0:(genops.c:1385:class_connect()) connect: client 7b50befa-471f-4f69-9917-f69b46ba475e, cookie 0xbb0e330328bbf7c0 00000100:00080000:2.0:1788620159.825305:0:19008:0:(import.c:65:import_set_state_nolock()) ffff933286c9d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788620159.825400:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328493b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+5:3308:x1875503677033088:12345-0@lo:250:mount.lustre.0 Request processed in 408us (8997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620159.825408:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620159.825519:0:3308:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788620159.825529:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.112@tcp: connect to target with instance 0 00000100:00080000:3.0:1788620159.825537:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788620159.825542:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788620159.825545:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333bbfab800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788620159.825547:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788620159.825568:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788620159.825574:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b50befa-471f-4f69-9917-f69b46ba475e:3308:1875503677033088:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788620159.828547:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620159.828797:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788620159.828840:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788620159.835597:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788620159.835609:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788620159.839431:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788620159.839540:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788620159.840644:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620159.841004:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788620159.841010:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788620159.844612:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788620159.844626:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788620159.878709:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620159.879001:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788620159.879007:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788620159.880653:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788620159.880664:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788620159.881516:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620159.881746:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788620159.881752:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788620159.882453:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788620159.882461:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788620159.883478:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620159.883658:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788620159.883664:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788620159.884681:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788620159.884697:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788620159.885485:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620159.885722:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788620159.885727:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788620159.886329:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788620159.886337:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788620159.900522:0:18997:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620159.900726:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788620159.900733:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788620159.902335:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788620159.902347:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788620159.903286:0:18997:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788620159.903294:0:18997:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788620159.903965:0:18997:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788620159.903987:0:18997:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788620159.903994:0:18997:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788620159.904131:0:18997:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788620159.904165:0:18997:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788620159.904170:0:18997:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788620159.904171:0:18997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788620159.904173:0:18997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620159.904174:0:18997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620159.904175:0:18997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620159.904247:0:18997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620159.904248:0:18997:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788620159.904250:0:18997:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788620159.904251:0:18997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620159.904253:0:18997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788620159.904255:0:18997:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788620159.904257:0:18997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788620159.904258:0:18997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788620159.904259:0:18997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620159.904261:0:18997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620159.904262:0:18997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620159.904263:0:18997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620159.904264:0:18997:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788620159.904264:0:18997:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788620159.904270:0:18997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620159.904271:0:18997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788620159.904296:0:18997:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788620159.904314:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033216:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788620159.904394:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620159.904483:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788620159.904576:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677033216 00000100:00100000:3.0:1788620159.904584:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677033216 00000100:00100000:3.0:1788620159.904668:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620159.904678:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+5:18997:x1875503677033216:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788620159.904726:0:19010:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788620159.904729:0:19010:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788620159.904732:0:19010:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788620159.905108:0:19032:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788620159.905649:0:19010:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:2.0:1788620159.906761:0:19033:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788620159.906767:0:19033:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788620159.906941:0:19033:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788620159.906985:0:19033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788620159.907369:0:19010:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788620159.907380:0:19010:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788620159.912806:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+5:18997:x1875503677033216:12345-0@lo:253:mount.lustre.0 Request processed in 8089us (8372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620159.912829:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620159.913018:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033216:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788620159.913034:0:18997:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788620159.913038:0:18997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788620159.913040:0:18997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788620159.913041:0:18997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620159.913043:0:18997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620159.913044:0:18997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620159.913045:0:18997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620159.913046:0:18997:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788620159.913048:0:18997:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788620159.913050:0:18997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620159.913052:0:18997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788620159.913074:0:18997:0:(tgt_mount.c:101:server_register_mount()) register mount ffff933390d8c000 from lustre-MDT0000 10000000:01000000:0.0:1788620159.913103:0:18997:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788620159.913106:0:18997:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788620159.913110:0:18997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9332843bb380 10000000:01000000:0.0:1788620159.913115:0:18997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788620159.913124:0:18997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9332843bb380 from 1 10000000:01000000:0.0:1788620159.913127:0:18997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788620159.913165:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620159.913258:0:18997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620159.913272:0:18997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620159.913308:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620159.913938:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620159.914021:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620159.914883:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677033344 00000100:00100000:2.0:1788620159.914893:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677033344 00000100:00100000:2.0:1788620159.914980:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620159.914989:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+5:18997:x1875503677033344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620159.915005:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620159.915024:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc142200/0xbb0e330328bbf7ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf7c7 expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620159.915049:0:19009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc142200/0xbb0e330328bbf7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf7c7 expref: 6 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620159.915061:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc142200/0xbb0e330328bbf7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf7c7 expref: 6 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620159.915070:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142200, rc 0) 00000100:00100000:2.0:1788620159.915137:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+6:18997:x1875503677033344:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620159.915158:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620159.915251:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033344:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620159.915268:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620159.915277:0:18997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620159.915350:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620159.915379:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620159.915599:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620159.915680:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677033472 00000100:00100000:0.0:1788620159.915685:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677033472 00000100:00100000:0.0:1788620159.915708:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788620159.915714:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+6:18997:x1875503677033472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620159.915983:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+6:18997:x1875503677033472:12345-0@lo:501:mount.lustre.0 Request processed in 268us (602us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788620159.915991:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620159.916076:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033472:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788620159.916103:0:18997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788620159.916132:0:18997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620159.916142:0:18997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620159.916152:0:18997:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933390d8c000 10000000:01000000:1.0:1788620159.916157:0:18997:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788620159.916161:0:18997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff933390d8c000 10000000:01000000:1.0:1788620159.916164:0:18997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788620159.916167:0:18997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff933390d8c000 from 1 10000000:01000000:1.0:1788620159.916170:0:18997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788620159.916206:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620159.916215:0:18997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620159.916224:0:18997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620159.916240:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620159.916268:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620159.916288:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620159.916468:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677033600 00000100:00100000:0.0:1788620159.916474:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677033600 00000100:00100000:0.0:1788620159.916496:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620159.916503:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+6:18997:x1875503677033600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620159.916511:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620159.916525:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2c00/0xbb0e330328bbf7dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf7d5 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620159.916542:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2c00/0xbb0e330328bbf7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf7d5 expref: 7 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620159.916551:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2c00/0xbb0e330328bbf7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf7d5 expref: 7 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620159.916560:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2c00, rc 0) 00000100:00100000:0.0:1788620159.916638:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+7:18997:x1875503677033600:12345-0@lo:101:mount.lustre.0 Request processed in 134us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620159.916654:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620159.918310:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620159.918336:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf7d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7dc expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620159.918416:0:18997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf7d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf7dc expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620159.918450:0:18997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788620159.918518:0:18997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf7d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7dc expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620159.918527:0:18997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6800/0xbb0e330328bbf7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7dc expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620159.918536:0:18997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788620159.918542:0:18997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788620159.918549:0:18997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff933390d8c000 10000000:01000000:1.0:1788620159.918551:0:18997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788620159.918555:0:18997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788620159.918557:0:18997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788620159.918598:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620159.918606:0:18997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620159.918615:0:18997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620159.918633:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620159.918690:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620159.918734:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620159.918877:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677033728 00000100:00100000:2.0:1788620159.918884:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677033728 00000100:00100000:2.0:1788620159.918931:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620159.918940:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+7:18997:x1875503677033728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620159.918951:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620159.918963:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc143200/0xbb0e330328bbf7ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf7e3 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620159.918981:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc143200/0xbb0e330328bbf7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf7e3 expref: 8 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620159.918990:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc143200/0xbb0e330328bbf7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf7e3 expref: 8 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620159.918997:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143200, rc 0) 00000100:00100000:2.0:1788620159.919028:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+8:18997:x1875503677033728:12345-0@lo:101:mount.lustre.0 Request processed in 90us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620159.919034:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788620159.919461:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620159.919475:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf7e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ea expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620159.919492:0:18997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf7e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf7ea expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620159.919541:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620159.919570:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620159.919598:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620159.919651:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677033856 00000100:00100000:3.0:1788620159.919656:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677033856 00000100:00100000:3.0:1788620159.919690:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620159.919697:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+8:18997:x1875503677033856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620159.920135:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+9:18997:x1875503677033856:12345-0@lo:501:mount.lustre.0 Request processed in 438us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620159.920144:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620159.920394:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620159.920426:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620159.920467:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620159.920489:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620159.920600:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677033984 00000100:00100000:3.0:1788620159.920605:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677033984 00000100:00100000:3.0:1788620159.920641:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788620159.920648:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+9:18997:x1875503677033984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620159.920966:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+9:18997:x1875503677033984:12345-0@lo:503:mount.lustre.0 Request processed in 317us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620159.920974:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788620159.921111:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677033984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620159.921585:0:19034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19034:1875503677034112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620159.921642:0:19034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620159.921804:0:19034:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620159.921913:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677034112 00000100:00100000:1.0:1788620159.921919:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677034112 00000100:00100000:1.0:1788620159.922017:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788620159.922026:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+9:19034:x1875503677034112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620159.922456:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+9:19034:x1875503677034112:12345-0@lo:502:llog_process_th.0 Request processed in 430us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620159.922463:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788620159.922538:0:19034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19034:1875503677034112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788620159.922564:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620159.922577:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620159.922579:0:19034:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788620159.922584:0:19034:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788620159.922587:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788620159.922603:0:19034:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9332870a3380) 00000020:00000080:3.0:1788620159.922622:0:19034:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788620159.922627:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788620159.922706:0:19034:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788620159.922716:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf7f8 00000020:00000080:3.0:1788620159.922958:0:19034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788620159.922963:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620159.922966:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620159.922968:0:19034:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788620159.922970:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620159.922974:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620159.922975:0:19034:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788620159.922978:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788620159.922986:0:19034:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9332870a4d40) 00000020:00000080:3.0:1788620159.922995:0:19034:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788620159.923000:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788620159.923002:0:19034:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788620159.923004:0:19034:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788620159.923010:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788620159.923059:0:19034:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933390d8c000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788620159.923075:0:19034:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9332870a19c0) 00000020:00000080:3.0:1788620159.923083:0:19034:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788620159.923134:0:19034:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788620159.923147:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbf80d 00000020:00000080:3.0:1788620159.923243:0:19034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788620159.923249:0:19034:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788620159.923254:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbb0e330328bbf814 00080000:01000000:3.0:1788620159.923258:0:19034:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788620159.923261:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf81b 00010000:00010000:3.0:1788620160.014749:0:19034:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788620160.016654:0:19034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:3.0:1788620160.017101:0:19034:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788620160.018448:0:19034:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9333baaecd40) 00000020:00000080:3.0:1788620160.018470:0:19034:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788620160.018552:0:19034:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788620160.018560:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf829 00000020:00000080:2.0:1788620160.021511:0:19034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788620160.045272:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbb0e330328bbf830 00000020:00000080:3.0:1788620160.048044:0:19034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788620160.048057:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620160.048063:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620160.048066:0:19034:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788620160.048069:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788620160.048072:0:19034:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788620160.048073:0:19034:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620160.048075:0:19034:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620160.048077:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788620160.048079:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620160.048081:0:19034:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788620160.048083:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620160.048088:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620160.048090:0:19034:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788620160.048093:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788620160.048139:0:19034:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788620160.048154:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620160.048158:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620160.048159:0:19034:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788620160.048161:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788620160.048176:0:19034:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788620160.048179:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620160.048181:0:19034:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788620160.048185:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788620160.048190:0:19034:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:3.0:1788620160.048216:0:19034:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788620160.048219:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788620160.048233:0:19034:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9333baae99c0) 00000020:00000080:3.0:1788620160.048250:0:19034:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788620160.048262:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788620160.048326:0:19034:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788620160.048332:0:19034:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788620160.048339:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf83e 00010000:00080000:3.0:1788620160.048369:0:19034:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333ace0e800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788620160.049202:0:19034:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788620160.050225:0:19034:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788620160.050273:0:19034:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788620160.060721:0:19034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788620160.061365:0:19034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788620160.061524:0:19034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000020:00000080:1.0:1788620160.067929:0:19034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788620160.067947:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788620160.068008:0:19034:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788620160.068028:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbf845 00000100:00080000:1.0:1788620160.068040:0:19034:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788620160.068046:0:19034:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9333ace0e800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788620160.068092:0:19034:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bd0ace00 x1875503677034240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788620160.068124:0:19034:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788620160.068177:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620160.068182:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620160.068184:0:19034:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788620160.068187:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788620160.068189:0:19034:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788620160.068191:0:19034:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788620160.068192:0:19034:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788620160.068194:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788620160.068195:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620160.068196:0:19034:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788620160.068198:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788620160.068202:0:19034:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788620160.068204:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620160.068205:0:19034:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788620160.068207:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788620160.068211:0:19034:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.112@tcp to nid 0x20000c0a8cb70 (192.168.203.112@tcp) 00000020:01000000:1.0:1788620160.068236:0:19034:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788620160.068239:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788620160.068252:0:19034:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff933284858000) 00000020:00000080:1.0:1788620160.068264:0:19034:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788620160.068269:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788620160.068322:0:19034:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788620160.068327:0:19034:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788620160.068333:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbb0e330328bbf853 00010000:00080000:1.0:1788620160.068362:0:19034:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933385841800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.112@tcp at head 00000100:00100000:3.0:1788620160.068687:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677034240:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788620160.068742:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875503677034240 offset 0 length 520: 4 00000100:00100000:0.0:1788620160.068987:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b50befa-471f-4f69-9917-f69b46ba475e:3311:1875503677034368:0@lo:400:kworker.0 00000100:00100000:0.0:1788620160.069028:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620160.069206:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677034368 00000100:00100000:1.0:1788620160.069214:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677034368 00000100:00100000:1.0:1788620160.069258:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788620160.069267:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+9:3311:x1875503677034368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620160.069369:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+9:3311:x1875503677034368:12345-0@lo:400:kworker.0 Request processed in 102us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620160.069377:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788620160.070759:0:19034:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788620160.070979:0:19034:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788620160.071003:0:19034:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788620160.073024:0:19038:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788620160.073032:0:19038:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1788620160.073258:0:19034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788620160.073347:0:19034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788620160.074015:0:19034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:3.0:1788620160.076528:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b50befa-471f-4f69-9917-f69b46ba475e:3311:1875503677034368:0@lo:400:kworker.0 00000040:00080000:2.0:1788620160.076739:0:19040:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788620160.076744:0:19040:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788620160.080532:0:19034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788620160.080548:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788620160.080592:0:19034:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788620160.080624:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbf85a 00000100:00080000:2.0:1788620160.080633:0:19034:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788620160.080639:0:19034:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff933385841800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:2.0:1788620160.080675:0:19034:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933387fcdc00 x1875503677034496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788620160.080703:0:19034:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788620160.080830:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620160.080834:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.080836:0:19034:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788620160.080839:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620160.080843:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.080845:0:19034:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788620160.080848:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788620160.080850:0:19034:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788620160.080853:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620160.080855:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.080857:0:19034:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788620160.080859:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620160.080862:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.080863:0:19034:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788620160.080867:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788620160.080900:0:19034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19034:1875503677034624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620160.081051:0:19034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620160.081087:0:19034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333acecd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620160.081164:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677034624 00000100:00100000:1.0:1788620160.081171:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677034624 00000100:00100000:1.0:1788620160.081216:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788620160.081225:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+9:19034:x1875503677034624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620160.081498:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+9:19034:x1875503677034624:12345-0@lo:502:llog_process_th.0 Request processed in 273us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620160.081506:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788620160.081876:0:19034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19034:1875503677034624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788620160.081908:0:19034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788620160.081914:0:19034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788620160.081925:0:19034:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788620160.081931:0:19034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788620160.081985:0:18997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788620160.082002:0:18997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788620160.082021:0:18997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf7e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ea expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620160.082032:0:18997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6a00/0xbb0e330328bbf7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ea expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620160.082052:0:18997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933390d8c000 from 1 10000000:01000000:1.0:1788620160.082055:0:18997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788620160.082082:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620160.082090:0:18997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620160.082098:0:18997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620160.082113:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677034752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620160.082148:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620160.082173:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788620160.082372:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677034496:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788620160.082509:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875503677034496 offset 0 length 520: 4 00000100:00100000:2.0:1788620160.082591:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677034752 00000100:00100000:2.0:1788620160.082598:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677034752 00000100:00100000:2.0:1788620160.082640:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788620160.082648:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+9:18997:x1875503677034752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620160.082657:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620160.082671:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf861 expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.082703:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf861 expref: 10 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.082712:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf861 expref: 10 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.082720:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143400, rc 0) 00000100:00100000:2.0:1788620160.082762:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+10:18997:x1875503677034752:12345-0@lo:101:mount.lustre.0 Request processed in 115us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.082768:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788620160.082900:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677034752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620160.082975:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620160.082986:0:18997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620160.087303:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677034880:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788620160.087489:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620160.087526:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620160.087892:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677034880 00000100:00100000:1.0:1788620160.087901:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677034880 00000100:00100000:1.0:1788620160.087955:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788620160.087964:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+10:18997:x1875503677034880:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788620160.087984:0:19009:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788620160.087991:0:19009:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788620160.088071:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+10:18997:x1875503677034880:12345-0@lo:256:mount.lustre.0 Request processed in 107us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620160.088078:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788620160.088238:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677034880:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788620160.089321:0:18997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788620160.089379:0:18997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620160.089399:0:18997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620160.089479:0:18997:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933390d8c000 from 1 10000000:01000000:1.0:1788620160.089483:0:18997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788620160.089515:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620160.089536:0:18997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620160.089546:0:18997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620160.089565:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620160.089608:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620160.089644:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333908b9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788620160.089800:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677035008 00000100:00100000:2.0:1788620160.089806:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677035008 00000100:00100000:2.0:1788620160.089854:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620160.089862:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+10:18997:x1875503677035008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620160.089873:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620160.089886:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf86f expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.089907:0:19009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf86f expref: 11 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.089927:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf86f expref: 11 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.089935:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143a00, rc 0) 00000100:00100000:2.0:1788620160.089974:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+11:18997:x1875503677035008:12345-0@lo:101:mount.lustre.0 Request processed in 114us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.089980:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788620160.090242:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620160.090255:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620160.090264:0:18997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620160.090315:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620160.090338:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620160.090355:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426300 going to sleep for 11 seconds 00000100:00100000:2.0:1788620160.091318:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677035136 00000100:00100000:2.0:1788620160.091327:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677035136 00000100:00100000:2.0:1788620160.091371:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620160.091379:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+11:18997:x1875503677035136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620160.091753:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+11:18997:x1875503677035136:12345-0@lo:501:mount.lustre.0 Request processed in 374us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.091760:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788620160.092267:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620160.092307:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620160.092350:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620160.092389:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620160.092514:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677035264 00000100:00100000:1.0:1788620160.092519:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677035264 00000100:00100000:1.0:1788620160.092546:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788620160.092552:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+11:18997:x1875503677035264:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620160.092692:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+11:18997:x1875503677035264:12345-0@lo:503:mount.lustre.0 Request processed in 140us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620160.092699:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788620160.092793:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620160.093833:0:19042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19042:1875503677035392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620160.093888:0:19042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620160.093925:0:19042:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620160.094497:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677035392 00000100:00100000:1.0:1788620160.094504:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677035392 00000100:00100000:1.0:1788620160.094546:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788620160.094553:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+11:19042:x1875503677035392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788620160.094824:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+11:19042:x1875503677035392:12345-0@lo:502:llog_process_th.0 Request processed in 269us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620160.094830:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788620160.094956:0:19042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19042:1875503677035392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788620160.094985:0:19042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620160.094994:0:19042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.094996:0:19042:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788620160.095003:0:19042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933390d8c000 00000020:00000080:2.0:1788620160.095006:0:19042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788620160.095013:0:19042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620160.095015:0:19042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.095016:0:19042:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788620160.095018:0:19042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620160.095021:0:19042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.095022:0:19042:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788620160.095025:0:19042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933390d8c000 00000020:00000080:2.0:1788620160.095027:0:19042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788620160.095086:0:19042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620160.095089:0:19042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.095091:0:19042:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788620160.095093:0:19042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788620160.095095:0:19042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.095097:0:19042:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788620160.095100:0:19042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff933390d8c000 00000020:00000080:2.0:1788620160.095102:0:19042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788620160.095142:0:19042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19042:1875503677035520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620160.095182:0:19042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620160.095207:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677035520 00000100:00100000:2.0:1788620160.095211:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677035520 00000100:00100000:2.0:1788620160.095231:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620160.095237:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+11:19042:x1875503677035520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788620160.095366:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+11:19042:x1875503677035520:12345-0@lo:502:llog_process_th.0 Request processed in 128us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.095372:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620160.095426:0:19042:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426300 going to sleep for 11 seconds 00000100:00100000:2.0:1788620160.095439:0:19042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19042:1875503677035520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788620160.095458:0:19042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788620160.095462:0:19042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620160.095464:0:19042:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788620160.095467:0:19042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788620160.095526:0:18997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788620160.095542:0:18997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788620160.102587:0:18997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.102606:0:18997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620160.102666:0:18997:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788620160.102669:0:18997:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933390d8c000 10000000:01000000:2.0:1788620160.102672:0:18997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933390d8c000 10000000:01000000:2.0:1788620160.102677:0:18997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788620160.102683:0:18997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933390d8c000 from 1 10000000:01000000:2.0:1788620160.102685:0:18997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788620160.102733:0:18997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf87d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.102742:0:18997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf87d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.102752:0:18997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf87d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620160.102797:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620160.102877:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620160.102914:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333aff20540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620160.103019:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677035648 00000100:00100000:2.0:1788620160.103026:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677035648 00000100:00100000:2.0:1788620160.103073:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788620160.103081:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+11:18997:x1875503677035648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620160.103093:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620160.103106:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc142600/0xbb0e330328bbf884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf87d expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.103130:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc142600/0xbb0e330328bbf884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf87d expref: 12 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.103140:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc142600/0xbb0e330328bbf884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf87d expref: 12 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.103149:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142600, rc 0) 00000100:00100000:2.0:1788620160.103186:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+12:18997:x1875503677035648:12345-0@lo:101:mount.lustre.0 Request processed in 105us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.103192:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788620160.103247:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620160.103260:0:18997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf87d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf884 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.103268:0:18997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf87d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf884 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620160.103314:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620160.103339:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620160.103353:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333aff20540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620160.103365:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677035776 00000100:00100000:2.0:1788620160.103369:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677035776 00000100:00100000:2.0:1788620160.103385:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788620160.104662:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+12:18997:x1875503677035776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620160.106122:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+12:18997:x1875503677035776:12345-0@lo:501:mount.lustre.0 Request processed in 2723us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.106137:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788620160.120887:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620160.120964:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620160.121036:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620160.121070:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620160.121234:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677035904 00000100:00100000:1.0:1788620160.121241:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677035904 00000100:00100000:1.0:1788620160.121291:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788620160.121307:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+12:18997:x1875503677035904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620160.121510:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+12:18997:x1875503677035904:12345-0@lo:503:mount.lustre.0 Request processed in 203us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620160.121518:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788620160.121684:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677035904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620160.122099:0:19047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19047:1875503677036032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620160.122143:0:19047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620160.122169:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677036032 00000100:00100000:0.0:1788620160.122173:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677036032 00000100:00100000:0.0:1788620160.122200:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788620160.122208:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+12:19047:x1875503677036032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620160.122465:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+12:19047:x1875503677036032:12345-0@lo:502:llog_process_th.0 Request processed in 256us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620160.122474:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788620160.122519:0:19047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620160.122534:0:19047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19047:1875503677036032:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788620160.122586:0:19047:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788620160.122600:0:19047:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9332843b8000) 00000020:00000080:0.0:1788620160.122624:0:19047:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788620160.122694:0:19047:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933390d8c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788620160.122699:0:19047:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933390d8c000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788620160.122701:0:19047:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933390d8c000 4 00010000:00080000:0.0:1788620160.122730:0:19047:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933284da6000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.112@tcp at head 00010000:00010000:0.0:1788620160.129746:0:19047:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788620160.138349:0:19047:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788620160.138401:0:19047:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788620160.138416:0:19047:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbb0e330328bbf892 00000100:00080000:0.0:1788620160.138428:0:19047:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788620160.138434:0:19047:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff933284da6000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:0.0:1788620160.138469:0:19047:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333908a5500 x1875503677036160/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788620160.138499:0:19047:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788620160.138852:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677036160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788620160.138938:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620160.139358:0:19047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19047:1875503677036288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788620160.139544:0:19047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620160.139575:0:19047:0:(client.c:2716:ptlrpc_set_wait()) set ffff93339029b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788620160.139627:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677036288 00000100:00100000:3.0:1788620160.139635:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677036288 00000100:00100000:3.0:1788620160.139679:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788620160.139688:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+12:19047:x1875503677036288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788620160.139990:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+12:19047:x1875503677036288:12345-0@lo:502:llog_process_th.0 Request processed in 302us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620160.139998:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788620160.140158:0:19047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7b50befa-471f-4f69-9917-f69b46ba475e:19047:1875503677036288:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788620160.140187:0:19047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788620160.140243:0:18997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788620160.140264:0:18997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788620160.140278:0:18997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf87d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf884 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620160.140288:0:18997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc143e00/0xbb0e330328bbf87d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf884 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788620160.140329:0:18997:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788620160.140335:0:18997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788620160.140336:0:18997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620160.140337:0:18997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620160.140338:0:18997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620160.140339:0:18997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620160.140340:0:18997:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788620160.140341:0:18997:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788620160.140343:0:18997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620160.140344:0:18997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788620160.140349:0:18997:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788620160.140351:0:18997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788620160.140352:0:18997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788620160.140353:0:18997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620160.140353:0:18997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620160.140354:0:18997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620160.140355:0:18997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620160.140356:0:18997:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788620160.140357:0:18997:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788620160.140358:0:18997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620160.140359:0:18997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788620160.140372:0:18997:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788620160.140383:0:18997:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677036416:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788620160.140491:0:18997:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620160.140513:0:18997:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390e08a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620160.140534:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677036416 00000100:00100000:0.0:1788620160.140538:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677036416 00000100:00100000:0.0:1788620160.140571:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788620160.140578:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+12:18997:x1875503677036416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620160.140596:0:19009:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788620160.140609:0:19009:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788620160.152857:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677036160 00000100:00100000:1.0:1788620160.152872:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677036160 00000100:00100000:1.0:1788620160.153112:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620160.153122:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875503677036160:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788620160.153218:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875503677036160:12345-0@lo:38:llog_process_th.0 Request processed in 96us (14280us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788620160.153288:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788620160.153298:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933284da6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788620160.153302:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788620160.153307:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677036160:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788620160.155330:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 20000000:01000000:1.0:1788620160.205552:0:19009:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788620160.205574:0:19009:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788620160.205985:0:19032:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788620160.205991:0:19032:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788620160.206016:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620160.206036:0:19032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf861 expref: 12 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620160.206044:0:19032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620160.206100:0:19032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf861 expref: 12 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620160.206113:0:19032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf861 expref: 12 pid: 19010 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620160.206128:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19032:1875503677036544:0@lo:104: 00000100:00100000:3.0:1788620160.206194:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620160.206238:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333acd69000 going to sleep for 11 seconds 00000100:00100000:2.0:1788620160.208156:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677036544 00000100:00100000:2.0:1788620160.208170:0:18999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677036544 00000100:00100000:2.0:1788620160.208224:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620160.208233:0:18999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b50befa-471f-4f69-9917-f69b46ba475e+3:19032:x1875503677036544:12345-0@lo:104: 00010000:00010000:2.0:1788620160.208251:0:18999:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208338:0:18999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620160.208409:0:18999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b50befa-471f-4f69-9917-f69b46ba475e+3:19032:x1875503677036544:12345-0@lo:104: Request processed in 177us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.208417:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788620160.208451:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620160.208457:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208466:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6c00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620160.208471:0:19005:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208480:0:19005:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620160.208488:0:19005:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620160.208494:0:19005:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788620160.208532:0:19005:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208539:0:19005:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620160.208559:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208566:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6c00/0xbb0e330328bbf861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf868 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208582:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620160.208584:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620160.208586:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620160.208599:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b50befa-471f-4f69-9917-f69b46ba475e:3312:1875503677036672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788620160.208634:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620160.208700:0:19001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677036672 00000100:00100000:2.0:1788620160.208704:0:19001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677036672 00010000:00010000:2.0:1788620160.208721:0:19001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf861 expref: 13 pid: 19010 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620160.208742:0:19001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620160.208748:0:19001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b50befa-471f-4f69-9917-f69b46ba475e+13:3312:x1875503677036672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620160.208758:0:19001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620160.208763:0:19001:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf861 expref: 13 pid: 19010 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208803:0:19001:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf861 expref: 13 pid: 19010 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208830:0:19001:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208838:0:19001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788620160.208854:0:19001:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002862947s 00010000:00010000:2.0:1788620160.208859:0:19001:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208866:0:19001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208873:0:19001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208878:0:19001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208894:0:19001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620160.208898:0:19001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.208906:0:19001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.209608:0:19001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.209625:0:19001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620160.209673:0:19001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b50befa-471f-4f69-9917-f69b46ba475e+13:3312:x1875503677036672:12345-0@lo:103:ldlm_bl.0 Request processed in 923us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.209681:0:19001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620160.209724:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b50befa-471f-4f69-9917-f69b46ba475e:3312:1875503677036672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620160.209754:0:19032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc143400/0xbb0e330328bbf868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf861 expref: 12 pid: 19010 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620160.209764:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19032:1875503677036544:0@lo:104: 00010000:00010000:2.0:1788620160.209816:0:19032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.209825:0:19032:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.209832:0:19032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620160.209851:0:19032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338cca8e00/0xbb0e330328bbf899 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620160.217848:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+11:18997:x1875503677036416:12345-0@lo:253:mount.lustre.0 Request processed in 77258us (77344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620160.217865:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788620160.218106:0:18997:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:18997:1875503677036416:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788620160.218121:0:18997:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788620160.218125:0:18997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788620160.218127:0:18997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788620160.218128:0:18997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788620160.218129:0:18997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788620160.218131:0:18997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788620160.218132:0:18997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788620160.218134:0:18997:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788620160.218135:0:18997:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788620160.218137:0:18997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788620160.218138:0:18997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788620160.218157:0:18997:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788620160.228576:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620160.228748:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788620160.229546:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620160.229717:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788620160.230766:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620160.231090:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788620160.232766:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620160.233271:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788620160.233614:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620160.234008:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788620160.234284:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620160.234462:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788620160.271059:0:18997:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:1.0:1788620160.271324:0:18997:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788620160.271726:0:19056:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788620160.273894:0:19056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788620160.274716:0:18997:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788620160.274877:0:18997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788620160.275885:0:19055:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:2.0:1788620160.275892:0:19055:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000004:00000080:0.0:1788620160.277463:0:18997:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:00080000:1.0:1788620160.277899:0:19056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788620160.277988:0:19056:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788620160.277994:0:19056:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788620160.278262:0:18997:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788620160.278627:0:18997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620160.280135:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788620160.280758:0:18997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788620160.281221:0:18997:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788620160.282149:0:18997:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788620160.283300:0:18997:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:3.0:1788620160.288285:0:18997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788620160.317038:0:18997:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788620160.317072:0:18997:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbc7c018cb988 00100000:10000000:3.0:1788620160.317080:0:18997:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788620160.318220:0:18997:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788620160.318237:0:18997:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788620160.318250:0:18997:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788620160.318266:0:18997:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788620160.840236:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788620161.159623:0:19048:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788620161.159633:0:19048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788620161.160017:0:19048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788620161.160024:0:19048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1788620161.422508:0:19012:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788620161.422516:0:19012:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933390d8c000 from 9 10000000:01000000:1.0:1788620161.422521:0:19012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788620161.422563:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620161.422575:0:19012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620161.422586:0:19012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620161.422612:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677036800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788620161.422675:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620161.423298:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788620161.423853:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677036800 00000100:00100000:1.0:1788620161.423862:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677036800 00000100:00100000:1.0:1788620161.423909:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788620161.423917:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+11:19012:x1875503677036800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620161.423930:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620161.423948:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf8a0 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620161.424034:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf8a0 expref: 12 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620161.424045:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf8a0 expref: 12 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620161.424055:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed6200, rc 0) 00000100:00100000:1.0:1788620161.424331:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+12:19012:x1875503677036800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 414us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620161.424339:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788620161.424405:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677036800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620161.424422:0:19012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620161.424432:0:19012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620161.424489:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677036928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788620161.424526:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620161.424548:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788620161.425292:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677036928 00000100:00100000:2.0:1788620161.425300:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677036928 00000100:00100000:2.0:1788620161.425347:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788620161.425356:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+12:19012:x1875503677036928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788620161.425374:0:19009:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788620161.425390:0:19009:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788620161.425393:0:19009:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788620161.425484:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+12:19012:x1875503677036928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620161.425491:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788620161.425537:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677036928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788620161.425576:0:19012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788620161.425583:0:19012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620161.425602:0:19012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620161.864068:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788620162.183179:0:19048:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788620162.183188:0:19048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788620162.186556:0:19048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788620162.186666:0:19048:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788620162.186717:0:19048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1788620162.888952:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620163.915910:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620164.944182:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788620165.216709:0:19298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788620165.319090:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620165.319097:0:13043:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788620165.319101:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620165.319114:0:13043:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788620165.319117:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788620165.319121:0:13043:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788620165.319129:0:13043:0:(import.c:65:import_set_state_nolock()) ffff933284da6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620165.319142:0:13043:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff933284da6000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620165.319164:0:13043:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933387038a80 x1875503677037184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788620165.319223:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677037056:0@lo:400:kworker.0 00000100:00100000:3.0:1788620165.319292:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620165.319455:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677037056 00000100:00100000:3.0:1788620165.319464:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677037056 00000100:00100000:3.0:1788620165.319518:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788620165.319527:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+12:3309:x1875503677037056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620165.319585:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+12:3309:x1875503677037056:12345-0@lo:400:kworker.0 Request processed in 59us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620165.319593:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788620165.319647:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677037056:0@lo:400:kworker.0 00000100:00100000:1.0:1788620165.321155:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677037184:0@lo:38:kworker.0 00000100:00100000:1.0:1788620165.321222:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620165.321339:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677037184 00000100:00100000:3.0:1788620165.321347:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677037184 00000100:00100000:3.0:1788620165.321387:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620165.321394:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875503677037184:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788620165.321422:0:19018:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:3.0:1788620165.321463:0:19018:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbb0e330328bbf8ae 00000004:00100000:3.0:1788620165.321479:0:19018:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788620165.321653:0:19018:0:(import.c:65:import_set_state_nolock()) ffff933393147800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620165.321721:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875503677037184:12345-0@lo:38:kworker.0 Request processed in 327us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620165.321728:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788620165.323268:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff933387038a80 x1875503677037184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788620165.323288:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788620165.323298:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788620165.323303:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788620165.323306:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933284da6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788620165.323312:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875503677037184:0@lo:38:kworker.0 00010000:00010000:2.0:1788620165.959242:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620166.984377:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620168.006997:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788620168.635226:0:19450:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe95ef39e0 20000000:00000080:2.0:1788620168.635255:0:19450:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9333be5b3400 uarg=0000000000000000 20000000:01000000:2.0:1788620168.635288:0:19450:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788620168.635295:0:19450:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788620168.635300:0:19450:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788620168.640593:0:19451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788620168.646660:0:19450:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788620168.654302:0:19450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788620168.654431:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.654452:0:19450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf86f expref: 11 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.654462:0:19450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.654519:0:19450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf86f expref: 11 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.654536:0:19450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf86f expref: 11 pid: 19009 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620168.654550:0:19450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19450:1875503677037312:0@lo:104: 00000100:00100000:3.0:1788620168.654612:0:19450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.654674:0:19450:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395cd2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788620168.658840:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677037312 00000100:00100000:2.0:1788620168.658854:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677037312 00000100:00100000:2.0:1788620168.658905:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620168.658915:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+3:19450:x1875503677037312:12345-0@lo:104: 00010000:00010000:2.0:1788620168.658932:0:19000:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620168.659048:0:19000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620168.659055:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+3:19450:x1875503677037312:12345-0@lo:104: Request processed in 142us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620168.659063:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788620168.659067:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620168.659076:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.659086:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7200 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620168.659091:0:19004:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.659101:0:19004:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620168.659109:0:19004:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620168.659115:0:19004:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788620168.659151:0:19004:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.659157:0:19004:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620168.659184:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.659191:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed7200/0xbb0e330328bbf86f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf876 expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.659208:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620168.659210:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620168.659211:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620168.659224:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b50befa-471f-4f69-9917-f69b46ba475e:3310:1875503677037440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620168.659273:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620168.659448:0:19450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19450:1875503677037312:0@lo:104: 00010000:00010000:3.0:1788620168.659469:0:19450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620168.661909:0:19001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677037440 00000100:00100000:2.0:1788620168.661923:0:19001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677037440 00010000:00010000:3.0:1788620168.662085:0:19001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf86f expref: 12 pid: 19009 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620168.662135:0:19001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620168.662157:0:19001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b50befa-471f-4f69-9917-f69b46ba475e+12:3310:x1875503677037440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620168.662170:0:19001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620168.662176:0:19001:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf86f expref: 12 pid: 19009 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662188:0:19001:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf86f expref: 12 pid: 19009 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662205:0:19001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc143a00/0xbb0e330328bbf876 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf86f expref: 12 pid: 19009 timeout: 671 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662220:0:19001:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662228:0:19001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662244:0:19001:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662251:0:19001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662259:0:19001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662266:0:19001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662271:0:19001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620168.662276:0:19001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662290:0:19001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662313:0:19001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620168.662325:0:19001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788620168.662390:0:19001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b50befa-471f-4f69-9917-f69b46ba475e+11:3310:x1875503677037440:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (3116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620168.662398:0:19001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620168.662471:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b50befa-471f-4f69-9917-f69b46ba475e:3310:1875503677037440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620168.662514:0:19450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.662522:0:19450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620168.662528:0:19450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338cca9600/0xbb0e330328bbf8b5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620169.033160:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620170.057201:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788620170.246881:0:19012:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788620170.246890:0:19012:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933390d8c000 from 10 10000000:01000000:2.0:1788620170.246896:0:19012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788620170.246946:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.246959:0:19012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.246971:0:19012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620170.247060:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677037568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.247130:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620170.247255:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392fddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620170.247354:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677037568 00000100:00100000:0.0:1788620170.247361:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677037568 00000100:00100000:0.0:1788620170.247484:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788620170.247495:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+11:19012:x1875503677037568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620170.247509:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620170.247523:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf8bc expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620170.247546:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf8bc expref: 12 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620170.247558:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf8bc expref: 12 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620170.247567:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2a00, rc 0) 00000100:00100000:0.0:1788620170.247708:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+12:19012:x1875503677037568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620170.247716:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788620170.251639:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677037568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620170.251676:0:19012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620170.251690:0:19012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620170.251821:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677037696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.251882:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620170.251981:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392fddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620170.258735:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677037696 00000100:00100000:3.0:1788620170.258758:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677037696 00000100:00100000:3.0:1788620170.258837:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788620170.258848:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+12:19012:x1875503677037696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620170.259538:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+12:19012:x1875503677037696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 689us (7652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.259546:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788620170.259685:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677037696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.259755:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677037824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620170.259834:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620170.259861:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392fddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620170.259920:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677037824 00000100:00100000:0.0:1788620170.259926:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677037824 00000100:00100000:0.0:1788620170.260009:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788620170.260017:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+12:19012:x1875503677037824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620170.260172:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+12:19012:x1875503677037824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620170.260179:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788620170.260428:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677037824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788620170.266354:0:19512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788620170.266636:0:19012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788620170.266658:0:19012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620170.266669:0:19012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620170.266681:0:19012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620170.439022:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620160/real 1788620160] req@ffff933387fcdc00 x1875503677034496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620170 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620170.439055:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff933387fcdc00 x1875503677034496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620170 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620170.439066:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620160/real 1788620160] req@ffff9333bd0ace00 x1875503677034240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620170 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620170.439111:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9333bd0ace00 x1875503677034240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620170 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788620170.439129:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933385841800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620170.439148:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788620170.439152:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677034496:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788620170.439158:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333ace0e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620170.439163:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788620170.439166:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677034240:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788620170.439546:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620170.439552:0:13043:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788620170.439561:0:13043:0:(import.c:65:import_set_state_nolock()) ffff9333ace0e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620170.439566:0:13043:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 563 00000100:00080000:3.0:1788620170.439571:0:13043:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788620170.439577:0:13043:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9333ace0e800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620170.439611:0:13043:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93338703bb80 x1875503677037952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620170.440953:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677037952:0@lo:8:kworker.0 00000400:00000100:1.0:1788620170.441021:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875503677037952 offset 0 length 520: 4 00000100:00080000:3.0:1788620170.441113:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620170.441118:0:13043:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788620170.441120:0:13043:0:(import.c:65:import_set_state_nolock()) ffff933385841800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620170.441124:0:13043:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 563 00000100:00080000:3.0:1788620170.441128:0:13043:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788620170.441133:0:13043:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff933385841800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620170.441157:0:13043:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff93338703aa00 x1875503677038080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620170.448734:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677038080:0@lo:8:kworker.0 00000400:00000100:1.0:1788620170.448953:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875503677038080 offset 0 length 520: 4 00000100:00100000:2.0:1788620170.449294:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677038208:0@lo:400:kworker.0 00000100:00100000:2.0:1788620170.449345:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620170.449747:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677038208 00000100:00100000:3.0:1788620170.449755:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677038208 00000100:00100000:3.0:1788620170.449834:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620170.449843:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677038208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620170.449909:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677038208:12345-0@lo:400:kworker.0 Request processed in 67us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620170.449916:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788620170.450118:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff93338703b800 x1875503677038208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620170.450132:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677038208:0@lo:400:kworker.0 00010000:00010000:0.0:1788620171.080589:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620172.116034:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788620172.430956:0:19048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788620173.132593:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620174.150951:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788620174.405828:0:19701:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788620174.405833:0:19701:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788620174.405946:0:19701:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff933284da0000 00000020:01000004:0.0:1788620174.405962:0:19701:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788620174.405973:0:19701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788620174.405987:0:19701:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9332843b99c0) 00000020:00000080:0.0:1788620174.406003:0:19701:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788620174.446795:0:19701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788620174.447084:0:19701:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788620174.450626:0:19701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788620174.450896:0:19701:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788620174.451150:0:19701:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1788620174.451867:0:19701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788620174.451960:0:19701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788620174.452048:0:19701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788620174.454130:0:19701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:0.0:1788620174.457122:0:19701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00100000:10000000:0.0:1788620174.458036:0:19701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:0.0:1788620174.458703:0:19701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00100000:10000000:0.0:1788620174.459062:0:19701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:0.0:1788620174.459378:0:19701:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00000020:00000080:0.0:1788620174.460188:0:19701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788620174.460200:0:19701:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788620174.460209:0:19701:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb0e330328bbf8d1 00000020:01000004:0.0:1788620174.460218:0:19701:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788620174.460314:0:19701:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788620174.460325:0:19701:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788620174.460332:0:19701:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788620174.460337:0:19701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788620174.460348:0:19701:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9333bd1d4d40) 00000020:00000080:0.0:1788620174.460359:0:19701:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788620174.478071:0:19701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788620174.478438:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788620174.478444:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788620174.483194:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788620174.483206:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788620174.483667:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788620174.483673:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788620174.497801:0:19701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620174.499279:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788620174.499288:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788620174.500673:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788620174.500685:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788620174.542399:0:19701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788620174.542740:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788620174.542747:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788620174.544559:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788620174.544582:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788620174.545747:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788620174.545758:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788620174.549411:0:19701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620174.549691:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788620174.549699:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788620174.550550:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788620174.550658:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788620174.613305:0:19701:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788620174.613504:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788620174.613511:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788620174.617588:0:19701:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788620174.617602:0:19701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788620174.618296:0:19701:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788620174.618324:0:19701:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788620174.618331:0:19701:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788620174.654804:0:19701:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788620174.658626:0:19701:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.112@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788620174.658635:0:19701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788620174.658638:0:19701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620174.658650:0:19701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620174.658652:0:19701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620174.658653:0:19701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620174.658654:0:19701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620174.658656:0:19701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620174.658657:0:19701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620174.658659:0:19701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788620174.658664:0:19701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788620174.658667:0:19701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788620174.658668:0:19701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620174.658669:0:19701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620174.658670:0:19701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620174.658671:0:19701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620174.658673:0:19701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620174.658674:0:19701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620174.658675:0:19701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620174.658676:0:19701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788620174.661574:0:19701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788620174.661611:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788620174.661720:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620174.661797:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387611840 going to sleep for 11 seconds 00000100:00100000:3.0:1788620174.661859:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677038336 00000100:00100000:3.0:1788620174.662022:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677038336 00000100:00100000:3.0:1788620174.662156:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788620174.662166:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+12:19701:x1875503677038336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788620174.662197:0:19009:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788620174.662200:0:19009:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788620174.662204:0:19009:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788620174.690345:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+12:19701:x1875503677038336:12345-0@lo:253:mount.lustre.0 Request processed in 28170us (28626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620174.690361:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788620174.690459:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788620174.690476:0:19701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788620174.690479:0:19701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620174.690480:0:19701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620174.690482:0:19701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620174.690483:0:19701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620174.690484:0:19701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620174.690485:0:19701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620174.690487:0:19701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620174.690488:0:19701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620174.690490:0:19701:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788620174.690510:0:19701:0:(tgt_mount.c:101:server_register_mount()) register mount ffff933284da0000 from lustre-OST0000 10000000:01000000:2.0:1788620174.690536:0:19701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788620174.690539:0:19701:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788620174.690545:0:19701:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9332843bb380 local copy 00010000:00010000:2.0:1788620174.690556:0:19701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620174.690888:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620174.690924:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620174.690997:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333876116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620174.691521:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677038464 00000100:00100000:0.0:1788620174.691528:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677038464 00000100:00100000:0.0:1788620174.691890:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788620174.691901:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+12:19701:x1875503677038464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620174.692222:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+12:19701:x1875503677038464:12345-0@lo:501:mount.lustre.0 Request processed in 321us (1295us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788620174.692245:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788620174.692668:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038464:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788620174.692690:0:19701:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788620174.693423:0:19701:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788620174.693434:0:19701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620174.693445:0:19701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620174.693476:0:19701:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff933284da0000 10000000:01000000:2.0:1788620174.693481:0:19701:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788620174.693486:0:19701:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9332843bb380 10000000:01000000:2.0:1788620174.693488:0:19701:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788620174.693492:0:19701:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9332843bb380 from 1 10000000:01000000:2.0:1788620174.693495:0:19701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788620174.693528:0:19701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143800/0xbb0e330328bbf8df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620174.693537:0:19701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc143800/0xbb0e330328bbf8df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620174.693547:0:19701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc143800/0xbb0e330328bbf8df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620174.693578:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620174.693622:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620174.693697:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677038592 00000100:00100000:0.0:1788620174.693703:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677038592 00000100:00100000:3.0:1788620174.693933:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333876116c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.694143:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788620174.694156:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+12:19701:x1875503677038592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620174.694169:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620174.694185:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c1ed7e00/0xbb0e330328bbf8e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf8df expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.694305:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c1ed7e00/0xbb0e330328bbf8e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf8df expref: 13 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.694316:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c1ed7e00/0xbb0e330328bbf8e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf8df expref: 13 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.694324:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed7e00, rc 0) 00000100:00100000:1.0:1788620174.694365:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+13:19701:x1875503677038592:12345-0@lo:101:mount.lustre.0 Request processed in 213us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.694372:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788620174.694405:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620174.694419:0:19701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc143800/0xbb0e330328bbf8df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8e6 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.694429:0:19701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc143800/0xbb0e330328bbf8df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf8e6 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620174.694449:0:19701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788620174.694494:0:19701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143800/0xbb0e330328bbf8df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8e6 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.694500:0:19701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc143800/0xbb0e330328bbf8df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8e6 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620174.694504:0:19701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788620174.694508:0:19701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788620174.694517:0:19701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788620174.694518:0:19701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788620174.694536:0:19701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338cca9000/0xbb0e330328bbf8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.694543:0:19701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338cca9000/0xbb0e330328bbf8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.694550:0:19701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338cca9000/0xbb0e330328bbf8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620174.694563:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788620174.694594:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.694615:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406900 going to sleep for 11 seconds 00000100:00100000:0.0:1788620174.694630:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677038720 00000100:00100000:0.0:1788620174.694635:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677038720 00000100:00100000:0.0:1788620174.694668:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788620174.694676:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+13:19701:x1875503677038720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620174.694688:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620174.694697:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c3a00/0xbb0e330328bbf8f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf8ed expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620174.694735:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c3a00/0xbb0e330328bbf8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf8ed expref: 14 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620174.694890:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c3a00/0xbb0e330328bbf8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf8ed expref: 14 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620174.694900:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3a00, rc 0) 00000100:00100000:0.0:1788620174.694938:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677038720:12345-0@lo:101:mount.lustre.0 Request processed in 263us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620174.694944:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788620174.694983:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620174.694994:0:19701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338cca9000/0xbb0e330328bbf8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8f4 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.695002:0:19701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338cca9000/0xbb0e330328bbf8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf8f4 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620174.695724:0:19701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788620174.697568:0:19701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620174.698452:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788620174.698513:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788620174.698547:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788620174.698598:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788620174.698634:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788620174.698664:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788620174.698723:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788620174.698815:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788620174.698853:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788620174.698905:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788620174.698941:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788620174.699007:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788620174.699367:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788620174.699377:0:19701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788620174.699473:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620174.699541:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.699625:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.703925:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677038848 00000100:00100000:1.0:1788620174.703942:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677038848 00000100:00100000:1.0:1788620174.704067:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788620174.704079:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677038848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620174.704732:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677038848:12345-0@lo:501:mount.lustre.0 Request processed in 653us (5189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.704740:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788620174.711207:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620174.711293:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038976:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620174.711377:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.711413:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620174.711546:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677038976 00000100:00100000:0.0:1788620174.711554:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677038976 00000100:00100000:0.0:1788620174.711611:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788620174.711621:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677038976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788620174.714004:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677038976:12345-0@lo:503:mount.lustre.0 Request processed in 2376us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620174.714018:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788620174.718166:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677038976:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788620174.719326:0:19701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788620174.719420:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620174.719497:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620174.719581:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620174.719630:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677039104 00000100:00100000:3.0:1788620174.719637:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677039104 00000100:00100000:3.0:1788620174.719724:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788620174.719733:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677039104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620174.720402:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677039104:12345-0@lo:502:mount.lustre.0 Request processed in 667us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620174.720412:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788620174.720493:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788620174.720918:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788620174.721051:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788620174.721090:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788620174.721141:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788620174.721188:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788620174.721300:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788620174.721352:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788620174.721390:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788620174.721424:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788620174.721470:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788620174.721502:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788620174.721610:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788620174.721652:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620174.721724:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620174.721905:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620174.721987:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677039232 00000100:00100000:0.0:1788620174.721994:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677039232 00000100:00100000:0.0:1788620174.722047:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788620174.722109:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677039232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620174.722424:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677039232:12345-0@lo:502:mount.lustre.0 Request processed in 316us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620174.722432:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788620174.722556:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620174.722643:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788620174.722654:0:19701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788620174.727039:0:19715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788620174.727663:0:19715:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788620174.727672:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620174.727674:0:19715:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788620174.727681:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788620174.727696:0:19715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9332849ccd40) 00000020:00000080:2.0:1788620174.727731:0:19715:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788620174.727737:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788620174.727927:0:19715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933284da0000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788620174.727936:0:19715:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788620174.727943:0:19715:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbb0e330328bbf902 00010000:00010000:2.0:1788620174.734651:0:19715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788620174.738690:0:19715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:2.0:1788620174.743518:0:19715:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1788620174.745812:0:19715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788620174.745825:0:19715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620174.745831:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.745834:0:19715:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788620174.745838:0:19715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788620174.745847:0:19715:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788620174.745849:0:19715:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620174.745851:0:19715:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788620174.745852:0:19715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788620174.745855:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.745856:0:19715:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788620174.745859:0:19715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620174.745861:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.745863:0:19715:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788620174.745865:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788620174.745867:0:19715:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788620174.745869:0:19715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620174.745871:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.745872:0:19715:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788620174.745874:0:19715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620174.745876:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.745877:0:19715:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788620174.745880:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788620174.745944:0:19715:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620174.745948:0:19715:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.745950:0:19715:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788620174.745953:0:19715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788620174.747221:0:19701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788620174.747267:0:19701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788620174.747295:0:19701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338cca9000/0xbb0e330328bbf8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8f4 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620174.747309:0:19701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338cca9000/0xbb0e330328bbf8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf8f4 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620174.747317:0:19701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933284da0000 from 1 10000000:01000000:0.0:1788620174.747320:0:19701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620174.747355:0:19701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620174.747364:0:19701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620174.747374:0:19701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620174.747398:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620174.747475:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620174.747513:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395e176c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620174.748163:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677039360 00000100:00100000:0.0:1788620174.748173:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677039360 00000100:00100000:0.0:1788620174.748226:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788620174.748236:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+14:19701:x1875503677039360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620174.748349:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620174.748365:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf909 expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620174.748393:0:19009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf909 expref: 15 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620174.748416:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf909 expref: 15 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620174.748425:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2400, rc 0) 00000100:00100000:0.0:1788620174.748487:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677039360:12345-0@lo:101:mount.lustre.0 Request processed in 252us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620174.748494:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788620174.748581:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620174.748598:0:19701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.748608:0:19701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788620174.749448:0:19701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:1.0:1788620174.749964:0:19701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788620174.752324:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788620174.752409:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788620174.752460:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788620174.752499:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788620174.752535:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788620174.752581:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788620174.752610:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788620174.752636:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788620174.752719:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788620174.752727:0:19701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:1.0:1788620174.752856:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620174.752933:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620174.753034:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620174.756558:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677039488 00000100:00100000:0.0:1788620174.756572:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677039488 00000100:00100000:0.0:1788620174.756663:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788620174.756672:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677039488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620174.756998:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677039488:12345-0@lo:501:mount.lustre.0 Request processed in 326us (4064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620174.757006:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788620174.757131:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620174.757184:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788620174.757232:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620174.757459:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333903216c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.757574:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677039616 00000100:00100000:1.0:1788620174.757580:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677039616 00000100:00100000:1.0:1788620174.757604:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788620174.757610:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677039616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620174.757793:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677039616:12345-0@lo:503:mount.lustre.0 Request processed in 182us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.757800:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788620174.757932:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788620174.759130:0:19701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788620174.759216:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620174.759352:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620174.759430:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395e176c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.759469:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677039744 00000100:00100000:1.0:1788620174.759476:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677039744 00000100:00100000:1.0:1788620174.759548:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788620174.759556:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677039744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620174.759845:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677039744:12345-0@lo:502:mount.lustre.0 Request processed in 289us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.759852:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788620174.760009:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788620174.760399:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788620174.760453:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788620174.760524:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788620174.760565:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788620174.760599:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788620174.760648:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788620174.760696:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788620174.760741:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1788620174.761198:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620174.761511:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.761583:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390321c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788620174.761621:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677039872 00000100:00100000:0.0:1788620174.761629:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677039872 00000100:00100000:0.0:1788620174.761724:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788620174.761735:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677039872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620174.761956:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677039872:12345-0@lo:502:mount.lustre.0 Request processed in 223us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620174.761964:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788620174.762076:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677039872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620174.762194:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788620174.762208:0:19701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788620174.763295:0:19719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620174.763306:0:19719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.763309:0:19719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788620174.763315:0:19719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933284da0000 00000020:00000080:3.0:1788620174.763317:0:19719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620174.763324:0:19719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620174.763326:0:19719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.763334:0:19719:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788620174.763338:0:19719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620174.763342:0:19719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.763343:0:19719:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788620174.763346:0:19719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff933284da0000 00000020:00000080:3.0:1788620174.763348:0:19719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620174.763405:0:19719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620174.763409:0:19719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.763410:0:19719:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788620174.763413:0:19719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620174.763416:0:19719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.763417:0:19719:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788620174.763420:0:19719:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff933284da0000 00000020:00000080:3.0:1788620174.763422:0:19719:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620174.763460:0:19719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620174.763464:0:19719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620174.763465:0:19719:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788620174.763468:0:19719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1788620174.770216:0:19701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788620174.770865:0:19701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788620174.772341:0:19701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620174.772357:0:19701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620174.772420:0:19701:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788620174.772423:0:19701:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff933284da0000 10000000:01000000:2.0:1788620174.772427:0:19701:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff933284da0000 10000000:01000000:2.0:1788620174.772431:0:19701:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788620174.772437:0:19701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff933284da0000 from 1 10000000:01000000:2.0:1788620174.772440:0:19701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788620174.772478:0:19701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143a00/0xbb0e330328bbf917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620174.772487:0:19701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc143a00/0xbb0e330328bbf917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620174.772500:0:19701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc143a00/0xbb0e330328bbf917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620174.772535:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788620174.772604:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620174.772655:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333acd4b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.772804:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677040000 00000100:00100000:1.0:1788620174.772811:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677040000 00000100:00100000:1.0:1788620174.772851:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788620174.772859:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677040000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620174.772872:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620174.772883:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c1ed7a00/0xbb0e330328bbf91e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf917 expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.772908:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c1ed7a00/0xbb0e330328bbf91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf917 expref: 16 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.772918:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c1ed7a00/0xbb0e330328bbf91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf917 expref: 16 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.772935:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c1ed7a00, rc 0) 00000100:00100000:1.0:1788620174.772976:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040000:12345-0@lo:101:mount.lustre.0 Request processed in 117us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.772983:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788620174.774848:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620174.774873:0:19701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc143a00/0xbb0e330328bbf917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf91e expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620174.774886:0:19701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc143a00/0xbb0e330328bbf917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf91e expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788620174.777677:0:19701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1788620174.778502:0:19701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788620174.778851:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788620174.778895:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788620174.778927:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788620174.778976:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788620174.779016:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788620174.779970:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788620174.780031:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788620174.780148:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788620174.780219:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788620174.782501:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788620174.782557:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788620174.782653:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788620174.782691:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788620174.782744:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788620174.782819:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788620174.782858:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788620174.782890:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788620174.782956:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788620174.782993:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788620174.783027:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788620174.783896:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788620174.783954:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788620174.783991:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788620174.784042:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788620174.784154:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1788620174.784189:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1788620174.784716:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1788620174.785163:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1788620174.785208:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1788620174.785442:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1788620174.785484:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1788620174.785523:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1788620174.785558:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1788620174.785616:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1788620174.785653:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1788620174.785720:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1788620174.785761:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1788620174.786354:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1788620174.786415:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1788620174.786452:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1788620174.786561:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1788620174.786569:0:19701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1788620174.786676:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620174.786755:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620174.786821:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333acd4b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.790034:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677040128 00000100:00100000:1.0:1788620174.790063:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677040128 00000100:00100000:1.0:1788620174.790128:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788620174.790139:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620174.790473:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040128:12345-0@lo:501:mount.lustre.0 Request processed in 335us (3715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.790482:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788620174.790703:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788620174.790766:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788620174.790853:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620174.790885:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333acd4b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.791867:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677040256 00000100:00100000:1.0:1788620174.791877:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677040256 00000100:00100000:1.0:1788620174.791928:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788620174.791936:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620174.792610:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040256:12345-0@lo:503:mount.lustre.0 Request processed in 672us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.792618:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788620174.792717:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788620174.793475:0:19701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788620174.793572:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620174.793632:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620174.793663:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933385d6f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.793758:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677040384 00000100:00100000:1.0:1788620174.793765:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677040384 00000100:00100000:1.0:1788620174.793824:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788620174.793832:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620174.794034:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040384:12345-0@lo:502:mount.lustre.0 Request processed in 202us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.794042:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788620174.795396:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788620174.795678:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788620174.795757:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788620174.795830:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788620174.795873:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788620174.795901:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788620174.795950:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788620174.796002:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788620174.796036:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788620174.799325:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788620174.799410:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788620174.799446:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788620174.799496:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788620174.799533:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788620174.799569:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788620174.799618:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788620174.799649:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788620174.799677:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788620174.799732:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788620174.799767:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788620174.799822:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788620174.799867:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788620174.799898:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788620174.799949:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788620174.799998:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788620174.800036:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1788620174.802600:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1788620174.802696:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1788620174.802748:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1788620174.803803:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1788620174.803893:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1788620174.803933:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1788620174.803980:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1788620174.804016:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1788620174.804068:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1788620174.804107:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1788620174.804154:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1788620174.804191:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1788620174.804226:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1788620174.804299:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1788620174.804338:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1788620174.804393:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620174.804477:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620174.804533:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677040512 00000100:00100000:1.0:1788620174.804541:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677040512 00000100:00100000:1.0:1788620174.804592:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788620174.804601:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620174.806858:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040512:12345-0@lo:502:mount.lustre.0 Request processed in 2250us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.806873:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788620174.807011:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387430d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.807038:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788620174.807159:0:19701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1788620174.807176:0:19701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788620174.811629:0:19724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788620174.811646:0:19724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9333baae8000) 00000020:00000080:3.0:1788620174.811668:0:19724:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788620174.811750:0:19724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff933284da0000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788620174.811754:0:19724:0:(tgt_mount.c:187:server_put_mount()) put mount ffff933284da0000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788620174.811757:0:19724:0:(obd_mount.c:710:lustre_put_lsi()) put ffff933284da0000 3 00010000:00080000:3.0:1788620174.811826:0:19724:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9333bf427000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.112@tcp at head 00010000:00010000:3.0:1788620174.814030:0:19724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788620174.814525:0:19724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788620174.814563:0:19724:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788620174.814578:0:19724:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbb0e330328bbf92c 00000100:00080000:3.0:1788620174.814589:0:19724:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788620174.814595:0:19724:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9333bf427000 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620174.814631:0:19724:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933387039f80 x1875503677040640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788620174.814690:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677040640:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788620174.814788:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.814848:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677040640 00000100:00100000:3.0:1788620174.814855:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677040640 00000100:00100000:3.0:1788620174.814883:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620174.814890:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1875503677040640:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788620174.814912:0:19017:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:3.0:1788620174.814942:0:19017:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbb0e330328bbf933 00000004:00100000:3.0:1788620174.814957:0:19017:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788620174.814988:0:19017:0:(import.c:65:import_set_state_nolock()) ffff933390148000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620174.815035:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875503677040640:12345-0@lo:38:llog_process_th.0 Request processed in 144us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620174.815045:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788620174.816838:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff933387039f80 x1875503677040640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620174.816852:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788620174.816862:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788620174.816870:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788620174.816875:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788620174.816878:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333bf427000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788620174.816884:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875503677040640:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788620174.816905:0:19724:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1788620174.819348:0:19724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00080000:0.0:1788620174.821299:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620174.821307:0:13043:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788620174.821310:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788620174.821313:0:13043:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788620174.821388:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677040768:0@lo:400:kworker.0 00000100:00100000:0.0:1788620174.821454:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620174.821517:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677040768 00000100:00100000:0.0:1788620174.821524:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677040768 00000100:00100000:0.0:1788620174.821567:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788620174.821575:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677040768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620174.821622:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875503677040768:12345-0@lo:400:kworker.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620174.821628:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788620174.821667:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9333908a4000 x1875503677040768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620174.821681:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875503677040768:0@lo:400:kworker.0 00000020:01000000:2.0:1788620174.823129:0:19701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788620174.823170:0:19701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788620174.823195:0:19701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc143a00/0xbb0e330328bbf917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf91e expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620174.823208:0:19701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc143a00/0xbb0e330328bbf917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf91e expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788620174.823321:0:19701:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788620174.823323:0:19701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620174.823324:0:19701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620174.823325:0:19701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620174.823327:0:19701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620174.823328:0:19701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620174.823329:0:19701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620174.823331:0:19701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620174.823332:0:19701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788620174.823336:0:19701:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788620174.823338:0:19701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788620174.823340:0:19701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620174.823341:0:19701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620174.823342:0:19701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620174.823343:0:19701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620174.823344:0:19701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620174.823345:0:19701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620174.823346:0:19701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620174.823352:0:19701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788620174.823372:0:19701:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788620174.823386:0:19701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788620174.823441:0:19701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620174.823793:0:19701:0:(client.c:2716:ptlrpc_set_wait()) set ffff933385d6f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.823949:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677040896 00000100:00100000:1.0:1788620174.823956:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677040896 00000100:00100000:0.0:1788620174.824057:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788620174.824066:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+16:19701:x1875503677040896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620174.824094:0:19010:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788620174.824108:0:19010:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788620174.863917:0:19010:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788620174.863939:0:19010:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788620174.864019:0:19032:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788620174.864039:0:19032:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788620174.864070:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.864089:0:19032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf8a0 expref: 16 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.864098:0:19032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.864138:0:19032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf8a0 expref: 16 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.864152:0:19032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf8a0 expref: 16 pid: 19008 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620174.864167:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19032:1875503677041024:0@lo:104: 00000100:00100000:3.0:1788620174.864242:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620174.864287:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406240 going to sleep for 11 seconds 00000100:00100000:1.0:1788620174.866847:0:18999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677041024 00000100:00100000:1.0:1788620174.866863:0:18999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677041024 00000100:00100000:1.0:1788620174.866924:0:18999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620174.866949:0:18999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b50befa-471f-4f69-9917-f69b46ba475e+3:19032:x1875503677041024:12345-0@lo:104: 00010000:00010000:1.0:1788620174.866967:0:18999:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867081:0:18999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788620174.867087:0:18999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7b50befa-471f-4f69-9917-f69b46ba475e+3:19032:x1875503677041024:12345-0@lo:104: Request processed in 142us (2845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.867094:0:18999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788620174.867118:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620174.867124:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867132:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6400 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620174.867136:0:19005:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867145:0:19005:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620174.867152:0:19005:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620174.867157:0:19005:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788620174.867192:0:19005:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867199:0:19005:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620174.867218:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867235:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6400/0xbb0e330328bbf8a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf8a7 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867252:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620174.867253:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620174.867255:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620174.867282:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677041152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620174.867319:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620174.867379:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677041152 00000100:00100000:1.0:1788620174.867384:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677041152 00010000:00010000:1.0:1788620174.867401:0:19003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf8a0 expref: 17 pid: 19008 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620174.867421:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620174.867428:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b50befa-471f-4f69-9917-f69b46ba475e+17:3309:x1875503677041152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620174.867438:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620174.867444:0:19003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf8a0 expref: 17 pid: 19008 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867454:0:19003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf8a0 expref: 17 pid: 19008 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867485:0:19003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867495:0:19003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788620174.867510:0:19003:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003470956s 00010000:00010000:1.0:1788620174.867520:0:19003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867528:0:19003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867534:0:19003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867540:0:19003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867546:0:19003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620174.867550:0:19003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867557:0:19003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867565:0:19003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620174.867575:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620174.867604:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b50befa-471f-4f69-9917-f69b46ba475e+17:3309:x1875503677041152:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.867611:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620174.867645:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677041152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620174.868395:0:19032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333c1ed6200/0xbb0e330328bbf8a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf8a0 expref: 16 pid: 19008 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620174.868408:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19032:1875503677041024:0@lo:104: 00010000:00010000:3.0:1788620174.868525:0:19032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.868606:0:19032:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.868614:0:19032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620174.868636:0:19032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf93a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620174.892147:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+15:19701:x1875503677040896:12345-0@lo:253:mount.lustre.0 Request processed in 68072us (68695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620174.892161:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788620174.892305:0:19701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:19701:1875503677040896:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788620174.892321:0:19701:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788620174.892324:0:19701:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788620174.892326:0:19701:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788620174.892327:0:19701:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788620174.892328:0:19701:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788620174.892330:0:19701:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788620174.892331:0:19701:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788620174.892332:0:19701:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788620174.892334:0:19701:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788620174.892335:0:19701:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788620174.892353:0:19701:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788620174.892842:0:19701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620174.893013:0:19701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620174.893177:0:19701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620174.893333:0:19701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788620174.893485:0:19701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788620174.893694:0:19701:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788620174.901354:0:19701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788620174.982217:0:19701:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788620174.982227:0:19701:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788620174.982274:0:19701:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788620174.982341:0:19701:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788620174.982358:0:19701:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788620174.982388:0:19701:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788620175.175856:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788620176.136476:0:19012:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788620176.136485:0:19012:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933390d8c000 from 10 10000000:01000000:1.0:1788620176.136491:0:19012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788620176.136535:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620176.136547:0:19012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620176.136559:0:19012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620176.136585:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677041280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788620176.136654:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620176.136722:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933385d6fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788620176.136805:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677041280 00000100:00100000:3.0:1788620176.136814:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677041280 00000100:00100000:3.0:1788620176.136861:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788620176.136870:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+15:19012:x1875503677041280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620176.136884:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620176.136899:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbf941 expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620176.136921:0:19009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbf941 expref: 16 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620176.136932:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf941 expref: 16 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620176.136940:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338cca9c00, rc 0) 00000100:00100000:3.0:1788620176.136997:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+16:19012:x1875503677041280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620176.137003:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788620176.137048:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677041280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620176.137062:0:19012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620176.137070:0:19012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620176.137134:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677041408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788620176.137164:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620176.137182:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406240 going to sleep for 11 seconds 00000100:00100000:1.0:1788620176.137749:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677041408 00000100:00100000:1.0:1788620176.137756:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677041408 00000100:00100000:1.0:1788620176.137798:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788620176.137805:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:19012:x1875503677041408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788620176.137822:0:19008:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788620176.137839:0:19008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788620176.137842:0:19008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788620176.137924:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:19012:x1875503677041408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620176.137936:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788620176.140137:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677041408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788620176.140236:0:19012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788620176.140247:0:19012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620176.140259:0:19012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620176.201887:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620177.224382:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620178.249442:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620179.270889:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788620180.172188:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620180.172195:0:13043:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788620180.172199:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620180.172202:0:13043:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788620180.176591:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b50befa-471f-4f69-9917-f69b46ba475e:3310:1875503677041536:0@lo:400:kworker.0 00000100:00100000:3.0:1788620180.176687:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620180.176799:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677041664:0@lo:400:kworker.0 00000100:00100000:3.0:1788620180.176834:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620180.176864:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620180.176871:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677041792:0@lo:400:kworker.0 00000100:00100000:3.0:1788620180.176907:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620180.176949:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677041664 00000100:00100000:3.0:1788620180.176962:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677041664 00000100:00100000:3.0:1788620180.177012:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677041792 00000100:00100000:3.0:1788620180.177015:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677041792 00000100:00100000:3.0:1788620180.177045:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620180.177054:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677041664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620180.177107:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677041664:12345-0@lo:400:kworker.0 Request processed in 54us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620180.177113:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620180.177128:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788620180.177135:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677041792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620180.177161:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677041792:12345-0@lo:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620180.177167:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788620180.177200:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788620180.177226:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933387038000 x1875503677041792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620180.177240:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677041792:0@lo:400:kworker.0 00010000:00080000:3.0:1788620180.177251:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933387038700 x1875503677041664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620180.177260:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677041664:0@lo:400:kworker.0 00000100:00100000:1.0:1788620180.177909:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677041536 00000100:00100000:1.0:1788620180.177917:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677041536 00000100:00100000:1.0:1788620180.177955:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788620180.177963:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:3310:x1875503677041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620180.178033:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:3310:x1875503677041536:12345-0@lo:400:kworker.0 Request processed in 70us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620180.178039:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788620180.181128:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b50befa-471f-4f69-9917-f69b46ba475e:3310:1875503677041536:0@lo:400:kworker.0 00010000:00010000:1.0:1788620180.294866:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620181.322834:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788620181.649245:0:20067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788620182.343597:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788620182.668077:0:19048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788620183.367880:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620184.402008:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620185.094879:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620170/real 1788620170] req@ffff93338703aa00 x1875503677038080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620185 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620185.094912:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93338703aa00 x1875503677038080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620185 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620185.094923:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788620170/real 1788620170] req@ffff93338703bb80 x1875503677037952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620185 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620185.094934:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff93338703bb80 x1875503677037952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788620185 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788620185.094954:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933385841800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620185.094988:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788620185.094992:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677038080:0@lo:8:kworker.0 00000100:00080000:1.0:1788620185.094998:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333ace0e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620185.095003:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788620185.095006:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677037952:0@lo:8:kworker.0 00000100:00080000:3.0:1788620185.095145:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620185.095149:0:496:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788620185.095158:0:496:0:(import.c:65:import_set_state_nolock()) ffff9333ace0e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620185.095163:0:496:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 573 00000100:00080000:3.0:1788620185.095178:0:496:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788620185.095185:0:496:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9333ace0e800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620185.095206:0:496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933387038700 x1875503677042048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788620185.095219:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788620185.095223:0:496:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788620185.095225:0:496:0:(import.c:65:import_set_state_nolock()) ffff933385841800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620185.095228:0:496:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 573 00000100:00080000:3.0:1788620185.095230:0:496:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788620185.095232:0:496:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff933385841800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620185.095243:0:496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933387038000 x1875503677042176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788620185.095288:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677042432:0@lo:400:kworker.0 00000100:00100000:3.0:1788620185.095349:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620185.095415:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677042432 00000100:00100000:3.0:1788620185.095422:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677042432 00000100:00100000:3.0:1788620185.095472:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788620185.095479:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677042432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620185.095529:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677042432:12345-0@lo:400:kworker.0 Request processed in 50us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620185.095536:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788620185.095554:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788620185.095577:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933387038380 x1875503677042432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788620185.095598:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677042432:0@lo:400:kworker.0 00000100:00100000:1.0:1788620185.095795:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677041920:0@lo:400:kworker.0 00000100:00100000:1.0:1788620185.095838:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620185.095869:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620185.095876:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503677042304:0@lo:400:kworker.0 00000100:00100000:1.0:1788620185.095898:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620185.095922:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677042304 00000100:00100000:1.0:1788620185.095925:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677042304 00000100:00100000:1.0:1788620185.095951:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788620185.095957:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503677042304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620185.095990:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503677042304:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620185.095996:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788620185.096020:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933387039880 x1875503677042304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620185.096029:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503677042304:0@lo:400:kworker.0 00000100:00100000:1.0:1788620185.096046:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677042048:0@lo:8:kworker.0 00000100:00100000:1.0:1788620185.096069:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620185.096084:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677042176:0@lo:8:kworker.0 00000100:00100000:1.0:1788620185.096101:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620185.096141:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677042048 00000100:00100000:1.0:1788620185.096145:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677042048 00000100:00100000:1.0:1788620185.096159:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677042176 00000100:00100000:1.0:1788620185.096161:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677042176 00000100:00100000:1.0:1788620185.096184:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620185.096188:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1875503677042048:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788620185.096208:0:19704:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:1.0:1788620185.096237:0:19704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbf94f 00002000:00100000:1.0:1788620185.096251:0:19704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9333a53c6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788620185.096255:0:19704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788620185.096258:0:19704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788620185.096568:0:19704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788620185.096591:0:19704:0:(import.c:65:import_set_state_nolock()) ffff9333a53c3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620185.096632:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875503677042048:12345-0@lo:8:kworker.0 Request processed in 441us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620185.096649:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620185.096664:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620185.096669:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1875503677042176:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788620185.096680:0:19704:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788620185.096709:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1875503677042176:12345-0@lo:8:kworker.0 Request processed in 40us (607us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788620185.096716:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788620185.096749:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933387038700 x1875503677042048/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788620205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620185.096757:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788620185.096763:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788620185.096790:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788620185.096803:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788620185.096806:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9333ace0e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788620185.096829:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788620185.096834:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677042048:0@lo:8:kworker.0 00000100:00080000:1.0:1788620185.096848:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933385841800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620185.096851:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788620185.096854:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677042176:0@lo:8:kworker.0 00000100:00100000:3.0:1788620185.097042:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677041920 00000100:00100000:3.0:1788620185.097048:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677041920 00000100:00100000:3.0:1788620185.097083:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788620185.097091:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+16:3309:x1875503677041920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620185.097127:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+16:3309:x1875503677041920:12345-0@lo:400:kworker.0 Request processed in 37us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620185.097134:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000004:00080000:2.0:1788620185.097617:0:19039:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788620185.097649:0:19039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19039:1875503677042688:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788620185.097690:0:19039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620185.097710:0:19039:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31600 going to sleep for 11 seconds 00000004:00080000:2.0:1788620185.097728:0:19038:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788620185.098011:0:19038:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 588066238221ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788620185.098134:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677042560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620185.098165:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620185.098313:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677041920:0@lo:400:kworker.0 00000100:00100000:1.0:1788620185.098344:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677042688 00000100:00100000:1.0:1788620185.098349:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677042688 00000100:00100000:1.0:1788620185.098398:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788620185.098408:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19039:x1875503677042688:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788620185.100621:0:19706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677042560 00000100:00100000:2.0:1788620185.100656:0:19706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677042560 00000100:00100000:2.0:1788620185.100709:0:19706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620185.100720:0:19706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503677042560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620185.100757:0:19706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788620185.100850:0:19706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503677042560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (2684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620185.100857:0:19706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788620185.100902:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff933387fce680 x1875503677042560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788620185.100922:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677042560:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788620185.103091:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788620185.107675:0:19704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788620185.107686:0:19704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788620185.107692:0:19704:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00002000:00010000:1.0:1788620185.119083:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.119095:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119111:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.119117:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.119123:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119141:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119166:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119242:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119261:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620185.119274:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620185.119280:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119288:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620185.119292:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119304:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119321:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119329:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf956 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.119348:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.119355:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.119357:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.120248:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.120257:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.120268:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.120272:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.120277:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.120288:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.120297:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.120304:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.120326:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620185.121084:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620185.121092:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.121101:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620185.121112:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.121122:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.121154:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.121162:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020e8c313/0xbb0e330328bbf95d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.121191:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620185.121194:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620185.121196:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.121399:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.121406:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.121415:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.121418:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.121423:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.121440:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.121449:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.121468:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.121488:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.121748:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.121754:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.121761:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.121765:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.121794:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.121809:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.121817:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccff9265/0xbb0e330328bbf964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.121838:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.121840:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.121841:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.124388:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.124400:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124417:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.124422:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.124428:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124442:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124452:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124471:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124487:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620185.124500:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620185.124506:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124513:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620185.124518:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124527:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124541:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124548:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf96b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.124566:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.124567:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.124569:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.128406:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.128426:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.128442:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.128447:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.128454:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.128481:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.128491:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.128499:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.128518:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.128792:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.128800:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.128808:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.128813:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.128822:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.128840:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.128847:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aff5dcf4/0xbb0e330328bbf972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.128866:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.128867:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.128869:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.131211:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.131224:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.131240:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.131245:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.131252:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.131267:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.131285:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.131293:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.131345:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620185.131791:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.131799:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.131808:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.131812:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.131817:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.131827:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.131836:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.131843:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.131997:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620185.132005:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132026:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.132031:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132040:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132067:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132074:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005347f1fa/0xbb0e330328bbf979 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132091:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.132095:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132101:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.132104:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132111:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132120:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132134:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.132135:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.132137:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.132263:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620185.132269:0:19704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000115d0f19/0xbb0e330328bbf980 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620185.132731:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.132738:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.132748:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.132751:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.132756:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.132767:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.132796:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.132804:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132949:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.132955:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132963:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.132966:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132975:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132988:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.132996:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.132997:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.132999:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.133172:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620185.133178:0:19704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000226b2131/0xbb0e330328bbf987 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620185.134769:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.134800:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.134813:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.134818:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.134823:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.134836:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.134846:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.134853:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.134964:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.134973:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.134980:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.134984:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.135001:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.135018:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.135028:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.135031:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.135032:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.139574:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620185.139588:0:19704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a5f7385/0xbb0e330328bbf98e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.141141:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.142258:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.142270:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.142303:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.142308:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.142315:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.142328:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.142338:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.142345:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.142365:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.143355:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.143366:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.143378:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.143383:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.143393:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.143411:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.143418:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081f38ee9/0xbb0e330328bbf995 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.143457:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.143460:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.143462:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.145252:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.145263:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.145278:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.145283:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.145289:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.145301:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.145323:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.145330:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.145353:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.146320:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.146330:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.146340:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.146345:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.146356:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.146373:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.146380:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5a4466d/0xbb0e330328bbf99c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620185.146383:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.146389:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.146397:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.146397:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1788620185.146399:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.146401:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.146401:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.146406:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.146416:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.146425:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.146432:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.146480:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620185.147411:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.147420:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.147443:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.147448:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.147453:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.147562:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.147572:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.147579:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.147595:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788620185.148486:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620185.148495:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148515:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.148520:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148529:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148546:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148552:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002952d8c5/0xbb0e330328bbf9a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148572:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.148576:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148582:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed7c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.148585:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148591:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148599:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148613:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3a753d1/0xbb0e330328bbf9aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.148626:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.148628:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.148629:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.148644:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.150339:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.150352:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.150368:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.150380:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.150386:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.150399:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.150409:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.150417:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.150968:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.154299:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.154312:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.154326:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.154330:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.154341:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.154365:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.154374:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099fb42c7/0xbb0e330328bbf9b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.154396:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.154398:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.154411:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.156610:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.156704:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.156721:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.156725:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.156732:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.156747:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.156757:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.156786:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.156809:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.157498:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.157506:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.157516:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.157521:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.157531:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.157547:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.157555:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047dafe5b/0xbb0e330328bbf9b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.157572:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.157593:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.157594:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.160845:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.160861:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.162126:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.162135:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.162144:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.162164:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.162175:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.162183:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.162209:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.164614:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.164627:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.164649:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.164654:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.164678:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.164699:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.164707:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006779bdcd/0xbb0e330328bbf9bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.164727:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.164729:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.164730:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.176463:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.176478:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.176506:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.176511:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.176519:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.176536:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.176548:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.176557:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.176577:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.182935:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.182949:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.182964:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.182969:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.182981:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.183014:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.183036:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b442ba0/0xbb0e330328bbf9c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.183057:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.183059:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.183061:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788620185.185861:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788620185.191277:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.191293:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.191311:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.191316:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.191324:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.191340:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.191363:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.191372:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.191433:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620185.192023:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.192030:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.192039:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.192043:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.192047:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.192057:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.192065:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.192072:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.194624:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620185.194649:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.194665:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18fe00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.194670:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.194681:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.195019:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.195033:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e9a238/0xbb0e330328bbf9cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.195059:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.195063:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.195086:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.195193:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.195204:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.195215:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.195224:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.195225:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.195227:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620185.196832:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.196832:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620185.196844:0:19704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620185.197534:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.197543:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.197558:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.197564:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.197570:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.197585:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.197596:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.197604:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.197761:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620185.198146:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620185.198154:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.198164:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18ec00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620185.198169:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.198180:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.198201:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.198222:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003240dc0c/0xbb0e330328bbf9db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.198243:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620185.198246:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620185.198248:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.198271:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.198278:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.198292:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.198296:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.198300:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.198311:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.198320:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.198327:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.198346:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620185.198999:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620185.199005:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.199015:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620185.199019:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.199028:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.199054:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.199063:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000497e1b89/0xbb0e330328bbf9e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.199080:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620185.199082:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620185.199084:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.201507:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.201524:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.201543:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.201548:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.201555:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.201568:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.201590:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.201598:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.202350:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788620185.202942:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.202950:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.202963:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.202967:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.202972:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.202984:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.202993:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.203001:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207427:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620185.207442:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207456:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.207461:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207474:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207495:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207510:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e122a678/0xbb0e330328bbf9e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207536:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.207539:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207545:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18ea00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.207549:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207557:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207566:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.207573:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.207575:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.207577:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620185.210879:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620185.210892:0:19704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000312756f7/0xbb0e330328bbf9f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.210904:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.211993:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.212002:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.212031:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.212036:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.212042:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.212057:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.212067:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.212074:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.212089:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.212451:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.212460:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.212468:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18ee00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.212478:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.212488:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.212504:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.212512:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8253543/0xbb0e330328bbf9f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.212528:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.212530:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.212532:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788620185.220154:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788620185.220739:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.220765:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788620185.220871:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620185.220879:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.220895:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.220906:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.220914:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620185.220938:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788620185.221535:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620185.221544:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.221554:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1788620185.221557:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620185.221561:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.221572:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.221581:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.221596:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.221619:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788620185.221717:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620185.221726:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221734:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.221739:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221748:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221765:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221810:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c62f76c/0xbb0e330328bbf9fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221827:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.221830:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221837:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.221840:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221848:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221858:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221865:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbd1a1c3/0xbb0e330328bbfa05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.221876:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.221878:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.221880:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620185.221921:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620185.222186:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620185.222193:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.222201:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1788620185.222204:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620185.222208:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.222219:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.222227:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.222234:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.222253:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.222502:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.222508:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.222521:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.222525:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.222534:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.222547:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.222554:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c34d6b64/0xbb0e330328bbfa0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.222568:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.222570:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.222571:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620185.222633:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620185.222648:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.222662:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1788620185.222665:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620185.222670:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.222679:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.222688:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.222695:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.223333:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620185.223705:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620185.223713:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.223723:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620185.223728:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.223738:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.223753:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620185.223761:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b69bf49/0xbb0e330328bbfa13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.225052:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.225057:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.225059:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620185.225357:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620185.225366:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.225380:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1788620185.225385:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620185.225391:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.225404:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.225426:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.225435:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.225810:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620185.226288:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.226296:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.226306:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.226311:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.226333:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.226351:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.226359:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d90afe2/0xbb0e330328bbfa1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.226377:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.226379:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.226381:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788620185.226686:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620185.226693:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.226704:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1788620185.226709:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620185.226714:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.226727:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.226740:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.226749:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.227069:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788620185.227731:0:19704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788620185.227738:0:19704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.227748:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1788620185.227752:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620185.227757:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.227768:0:19704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.227818:0:19704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620185.227834:0:19704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.230954:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620185.230968:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.230982:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.230987:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.230998:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.231030:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.231063:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a1e242/0xbb0e330328bbfa21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.231093:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620185.231097:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.231102:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620185.231105:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.231113:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.231123:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.231131:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.231132:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620185.231134:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620185.231625:0:19704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788620185.231644:0:19704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e24fa5a/0xbb0e330328bbfa28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620185.231760:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788620185.232157:0:19704:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:0.0:1788620185.232258:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19039:x1875503677042688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 133849us (134564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620185.232279:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620185.233582:0:19039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19039:1875503677042688:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788620185.233598:0:19039:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788620185.233892:0:19039:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19039:1875503677042816:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788620185.233957:0:19039:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620185.234044:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677042816 00000100:00100000:2.0:1788620185.234050:0:19039:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bba31600 going to sleep for 11 seconds 00000100:00100000:3.0:1788620185.234126:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677042816 00000100:00100000:3.0:1788620185.235357:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788620185.235372:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:19039:x1875503677042816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788620185.235419:0:19703:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:3.0:1788620185.241183:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:19039:x1875503677042816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5809us (7218us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788620185.241198:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620185.241651:0:19039:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19039:1875503677042816:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788620185.241669:0:19039:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00000001:00100000:0.0:1788620185.380361:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788620185.380593:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:2.0:1788620185.418043:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620186.439036:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620187.464081:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620188.490098:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788620189.349691:0:20418:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788620189.349696:0:20418:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788620189.349846:0:20418:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9333bd31c800 00000020:01000004:0.0:1788620189.349879:0:20418:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788620189.349892:0:20418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788620189.349906:0:20418:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9333bd1d19c0) 00000020:00000080:0.0:1788620189.349921:0:20418:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788620189.363315:0:20418:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788620189.363580:0:20418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788620189.364413:0:20418:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788620189.364634:0:20418:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788620189.364937:0:20418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1788620189.365355:0:20418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 463: rc = 0 00100000:10000000:0.0:1788620189.365479:0:20418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 463: rc = 0 00100000:10000000:0.0:1788620189.365624:0:20418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 463: rc = 0 00100000:10000000:0.0:1788620189.366234:0:20418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 646: rc = 0 00100000:10000000:0.0:1788620189.366454:0:20418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:0.0:1788620189.366692:0:20418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 646: rc = 0 00100000:10000000:0.0:1788620189.366942:0:20418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 646: rc = 0 00100000:10000000:0.0:1788620189.367242:0:20418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:0.0:1788620189.367455:0:20418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 646: rc = 0 00000020:00000080:0.0:1788620189.368004:0:20418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788620189.368017:0:20418:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788620189.368034:0:20418:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb0e330328bbfa36 00000020:01000004:0.0:1788620189.368042:0:20418:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788620189.368063:0:20418:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.112@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788620189.368067:0:20418:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788620189.368073:0:20418:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788620189.368092:0:20418:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788620189.368097:0:20418:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788620189.376743:0:20418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788620189.376861:0:20418:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.112@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788620189.376867:0:20418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788620189.376868:0:20418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788620189.376869:0:20418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620189.376870:0:20418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620189.376871:0:20418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620189.376873:0:20418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620189.376874:0:20418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620189.376875:0:20418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620189.376877:0:20418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788620189.376881:0:20418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788620189.376883:0:20418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788620189.376884:0:20418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788620189.376885:0:20418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620189.376887:0:20418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620189.376888:0:20418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620189.376889:0:20418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620189.376890:0:20418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620189.376891:0:20418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620189.376892:0:20418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788620189.376919:0:20418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788620189.376940:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677042944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788620189.377021:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620189.377123:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.377225:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677042944 00000100:00100000:1.0:1788620189.377233:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677042944 00000100:00100000:1.0:1788620189.377286:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788620189.377294:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+16:20418:x1875503677042944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788620189.377323:0:19010:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788620189.377327:0:19010:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788620189.377331:0:19010:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788620189.386747:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+16:20418:x1875503677042944:12345-0@lo:253:mount.lustre.0 Request processed in 9444us (9717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.386761:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788620189.386909:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677042944:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788620189.386924:0:20418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788620189.386942:0:20418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788620189.386944:0:20418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788620189.386945:0:20418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620189.386946:0:20418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620189.386948:0:20418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620189.386949:0:20418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620189.386951:0:20418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620189.386952:0:20418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620189.386954:0:20418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788620189.386974:0:20418:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9333bd31c800 from lustre-OST0001 10000000:01000000:0.0:1788620189.387001:0:20418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788620189.387005:0:20418:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788620189.387013:0:20418:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9332843bb380 local copy 00010000:00010000:0.0:1788620189.387024:0:20418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620189.387256:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620189.387292:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620189.387330:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053900 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.387509:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677043072 00000100:00100000:1.0:1788620189.387523:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677043072 00000100:00100000:1.0:1788620189.387567:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788620189.387575:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:20418:x1875503677043072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620189.387856:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:20418:x1875503677043072:12345-0@lo:501:mount.lustre.0 Request processed in 281us (563us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788620189.387864:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788620189.388120:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043072:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788620189.388134:0:20418:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788620189.388402:0:20418:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788620189.388409:0:20418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620189.388419:0:20418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3c00/0xbb0e330328bbf7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbf7ce expref: -99 pid: 18997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620189.388442:0:20418:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9333bd31c800 10000000:01000000:0.0:1788620189.388448:0:20418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788620189.388452:0:20418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788620189.388459:0:20418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788620189.388463:0:20418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788620189.388467:0:20418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788620189.388492:0:20418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbfa3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620189.388500:0:20418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbfa3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620189.388510:0:20418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbfa3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620189.388526:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788620189.388559:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620189.388596:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053900 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.388664:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677043200 00000100:00100000:1.0:1788620189.388670:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677043200 00000100:00100000:1.0:1788620189.388711:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788620189.388720:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+16:20418:x1875503677043200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788620189.388731:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620189.388744:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18e600/0xbb0e330328bbfa44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbfa3d expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.388767:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18e600/0xbb0e330328bbfa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbfa3d expref: 17 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.388808:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18e600/0xbb0e330328bbfa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbfa3d expref: 17 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.388817:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18e600, rc 0) 00000100:00100000:1.0:1788620189.388846:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043200:12345-0@lo:101:mount.lustre.0 Request processed in 128us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.388852:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788620189.388971:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788620189.388983:0:20418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbfa3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa44 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620189.388993:0:20418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbfa3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbfa44 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620189.389668:0:20418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788620189.390526:0:20418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788620189.390736:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788620189.390862:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788620189.390896:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788620189.390936:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788620189.390972:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788620189.391008:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788620189.391071:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788620189.391120:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788620189.391358:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788620189.391420:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788620189.391428:0:20418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788620189.391511:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620189.391574:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620189.391674:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff93338367f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.391959:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677043328 00000100:00100000:1.0:1788620189.391967:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677043328 00000100:00100000:0.0:1788620189.392117:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788620189.392127:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788620189.392572:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043328:12345-0@lo:501:mount.lustre.0 Request processed in 445us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620189.392581:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788620189.392674:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620189.392714:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620189.392753:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.393052:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc440a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.393231:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677043456 00000100:00100000:1.0:1788620189.393236:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677043456 00000100:00100000:1.0:1788620189.393263:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788620189.393277:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043456:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620189.393625:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043456:12345-0@lo:503:mount.lustre.0 Request processed in 348us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.393631:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788620189.393740:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788620189.394736:0:20418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788620189.394833:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620189.394883:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.394916:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc440a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.395029:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677043584 00000100:00100000:1.0:1788620189.395034:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677043584 00000100:00100000:1.0:1788620189.395072:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788620189.395079:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620189.395430:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043584:12345-0@lo:502:mount.lustre.0 Request processed in 350us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.395438:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788620189.395534:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620189.395763:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788620189.396287:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788620189.396319:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788620189.396361:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788620189.396398:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788620189.396434:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788620189.396484:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788620189.396520:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788620189.396570:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788620189.396618:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620189.396669:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.396804:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc440a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788620189.396871:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677043712 00000100:00100000:0.0:1788620189.396878:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677043712 00000100:00100000:0.0:1788620189.396956:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788620189.396965:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620189.397182:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043712:12345-0@lo:502:mount.lustre.0 Request processed in 218us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620189.397189:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788620189.397667:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620189.397757:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788620189.397768:0:20418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788620189.398681:0:20419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788620189.398690:0:20419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788620189.398697:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788620189.398699:0:20419:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788620189.398705:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788620189.398718:0:20419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9332849cb380) 00000020:00000080:2.0:1788620189.398740:0:20419:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788620189.398746:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788620189.399040:0:20419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9333bd31c800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788620189.399049:0:20419:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788620189.399056:0:20419:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbb0e330328bbfa52 00010000:00010000:3.0:1788620189.403023:0:20419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788620189.403538:0:20419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:3.0:1788620189.405476:0:20419:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1788620189.406900:0:20419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788620189.406912:0:20419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620189.406917:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.406919:0:20419:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788620189.406922:0:20419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620189.406926:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.406927:0:20419:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788620189.406930:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788620189.406932:0:20419:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788620189.406934:0:20419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620189.406937:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.406938:0:20419:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788620189.406941:0:20419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620189.406944:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.406945:0:20419:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788620189.406948:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788620189.406996:0:20419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620189.406999:0:20419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.407001:0:20419:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788620189.407004:0:20419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788620189.407135:0:20418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788620189.407225:0:20418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788620189.407246:0:20418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbfa3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa44 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.407258:0:20418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3800/0xbb0e330328bbfa3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa44 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620189.407267:0:20418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333bd31c800 from 1 10000000:01000000:1.0:1788620189.407269:0:20418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788620189.407308:0:20418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.407317:0:20418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.407330:0:20418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620189.407365:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043840:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788620189.407438:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620189.407492:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5315cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620189.407599:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677043840 00000100:00100000:2.0:1788620189.407616:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677043840 00000100:00100000:2.0:1788620189.407666:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788620189.407675:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+17:20418:x1875503677043840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620189.407690:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620189.407704:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbfa59 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.407729:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbfa59 expref: 18 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.407740:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbfa59 expref: 18 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.407750:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143c00, rc 0) 00000100:00100000:2.0:1788620189.407828:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677043840:12345-0@lo:101:mount.lustre.0 Request processed in 153us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620189.407835:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788620189.407930:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620189.407944:0:20418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.407954:0:20418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620189.408446:0:20418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788620189.408710:0:20418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620189.408951:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788620189.408997:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788620189.409047:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788620189.409087:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788620189.409137:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788620189.409188:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788620189.409223:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788620189.409257:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788620189.409322:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788620189.409330:0:20418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788620189.409388:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620189.409440:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.409475:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.409658:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677043968 00000100:00100000:1.0:1788620189.409665:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677043968 00000100:00100000:1.0:1788620189.409699:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788620189.409708:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677043968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620189.409925:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677043968:12345-0@lo:501:mount.lustre.0 Request processed in 217us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.409933:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788620189.411289:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677043968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620189.411339:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620189.411394:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.411432:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.411489:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677044096 00000100:00100000:1.0:1788620189.411495:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677044096 00000100:00100000:1.0:1788620189.412246:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788620189.412258:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677044096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788620189.412634:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677044096:12345-0@lo:503:mount.lustre.0 Request processed in 377us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.412643:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788620189.413159:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788620189.413750:0:20418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788620189.413893:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620189.413949:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.414260:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620189.414449:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677044224 00000100:00100000:2.0:1788620189.414456:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677044224 00000100:00100000:2.0:1788620189.414493:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788620189.414501:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677044224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620189.414750:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677044224:12345-0@lo:502:mount.lustre.0 Request processed in 249us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620189.414758:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788620189.416290:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620189.416562:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788620189.416631:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788620189.416679:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788620189.416711:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788620189.416739:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788620189.416804:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788620189.416844:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788620189.416877:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788620189.416917:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620189.416983:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.417024:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620189.417110:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677044352 00000100:00100000:2.0:1788620189.417117:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677044352 00000100:00100000:2.0:1788620189.417241:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788620189.417251:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328493b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677044352:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788620189.417435:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328493b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677044352:12345-0@lo:502:mount.lustre.0 Request processed in 185us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620189.417443:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788620189.417540:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620189.417652:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788620189.417662:0:20418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788620189.420901:0:20423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620189.420913:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.420916:0:20423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788620189.420922:0:20423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9333bd31c800 00000020:00000080:3.0:1788620189.420925:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620189.420931:0:20423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620189.420934:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.420936:0:20423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788620189.420938:0:20423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620189.420941:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.420942:0:20423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788620189.420945:0:20423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9333bd31c800 00000020:00000080:3.0:1788620189.420947:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620189.420986:0:20423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620189.420989:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.420991:0:20423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788620189.420993:0:20423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788620189.421004:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.421006:0:20423:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788620189.421010:0:20423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9333bd31c800 00000020:00000080:3.0:1788620189.421012:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788620189.421051:0:20423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788620189.421054:0:20423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788620189.421055:0:20423:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788620189.421059:0:20423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1788620189.421104:0:20418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788620189.421125:0:20418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620189.421393:0:20418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.421405:0:20418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620189.421444:0:20418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788620189.421448:0:20418:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9333bd31c800 10000000:01000000:3.0:1788620189.421451:0:20418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9333bd31c800 10000000:01000000:3.0:1788620189.421454:0:20418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788620189.421459:0:20418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9333bd31c800 from 1 10000000:01000000:3.0:1788620189.421462:0:20418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788620189.421494:0:20418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338cca8400/0xbb0e330328bbfa67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.421502:0:20418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff93338cca8400/0xbb0e330328bbfa67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.421512:0:20418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff93338cca8400/0xbb0e330328bbfa67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620189.421533:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788620189.421600:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.421650:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc440840 going to sleep for 11 seconds 00000100:00100000:2.0:1788620189.422828:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677044480 00000100:00100000:2.0:1788620189.422841:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677044480 00000100:00100000:2.0:1788620189.422890:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788620189.422900:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677044480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788620189.422916:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620189.422934:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc143600/0xbb0e330328bbfa6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbfa67 expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.422960:0:19009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc143600/0xbb0e330328bbfa6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbfa67 expref: 19 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.422984:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc143600/0xbb0e330328bbfa6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbfa67 expref: 19 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.422993:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143600, rc 0) 00000100:00100000:2.0:1788620189.423053:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677044480:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620189.423060:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788620189.423281:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044480:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788620189.423299:0:20418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff93338cca8400/0xbb0e330328bbfa67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa6e expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.423307:0:20418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff93338cca8400/0xbb0e330328bbfa67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbfa6e expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620189.424069:0:20418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1788620189.425592:0:20418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788620189.425937:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788620189.425984:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788620189.426018:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788620189.426067:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788620189.426107:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788620189.427292:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788620189.427362:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788620189.427400:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788620189.427448:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788620189.427480:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788620189.427508:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788620189.427548:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788620189.427599:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788620189.427661:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788620189.427718:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788620189.427757:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788620189.427816:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788620189.427866:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788620189.427905:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788620189.427941:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788620189.428006:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788620189.428045:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788620189.428082:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788620189.430236:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788620189.430363:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1788620189.430401:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1788620189.430473:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1788620189.430507:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1788620189.430562:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1788620189.432505:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1788620189.432592:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1788620189.432640:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1788620189.432674:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1788620189.432733:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1788620189.432797:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1788620189.432850:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1788620189.432887:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1788620189.432921:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1788620189.432974:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1788620189.433008:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1788620189.433095:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1788620189.433102:0:20418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1788620189.434699:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620189.434765:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.435266:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.436257:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677044608 00000100:00100000:1.0:1788620189.436268:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677044608 00000100:00100000:1.0:1788620189.436321:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788620189.436331:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677044608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788620189.436628:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677044608:12345-0@lo:501:mount.lustre.0 Request processed in 297us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.436637:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788620189.438448:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788620189.438505:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044736:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620189.438570:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.438614:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677044736 00000100:00100000:3.0:1788620189.438620:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677044736 00000100:00100000:3.0:1788620189.438665:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788620189.438672:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677044736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788620189.439010:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677044736:12345-0@lo:503:mount.lustre.0 Request processed in 336us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620189.439018:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788620189.439067:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788620189.439081:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044736:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788620189.440705:0:20418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788620189.440816:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620189.440879:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.440918:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788620189.441269:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677044864 00000100:00100000:1.0:1788620189.441281:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677044864 00000100:00100000:1.0:1788620189.441326:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788620189.441334:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677044864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788620189.441624:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677044864:12345-0@lo:502:mount.lustre.0 Request processed in 289us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.441632:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788620189.443359:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620189.443682:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788620189.443743:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788620189.443814:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788620189.443867:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788620189.443907:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788620189.443958:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788620189.443995:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788620189.444030:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788620189.444081:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788620189.444120:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788620189.446017:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788620189.446099:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788620189.446130:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788620189.446172:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788620189.446211:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788620189.446240:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788620189.446292:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788620189.446339:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788620189.446373:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788620189.446404:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788620189.446448:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788620189.446487:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788620189.446518:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788620189.446558:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788620189.446591:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1788620189.447853:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1788620189.447945:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1788620189.447984:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1788620189.448018:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1788620189.448069:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1788620189.448102:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1788620189.448133:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1788620189.448288:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1788620189.448341:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1788620189.448377:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1788620189.448427:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1788620189.448462:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1788620189.448493:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1788620189.448539:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1788620189.448572:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1788620189.448635:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788620189.448718:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.451649:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620189.453319:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677044992 00000100:00100000:0.0:1788620189.453333:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677044992 00000100:00100000:0.0:1788620189.454677:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788620189.454697:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677044992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788620189.455022:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677044992:12345-0@lo:502:mount.lustre.0 Request processed in 331us (6303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620189.455031:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788620189.457035:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677044992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788620189.457254:0:20418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1788620189.457270:0:20418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788620189.459400:0:20428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788620189.459417:0:20428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff93328485b380) 00000020:00000080:1.0:1788620189.459439:0:20428:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788620189.459510:0:20428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9333bd31c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788620189.459514:0:20428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9333bd31c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788620189.459517:0:20428:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9333bd31c800 3 00010000:00080000:1.0:1788620189.459558:0:20428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff933393078800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.112@tcp at head 00010000:00010000:1.0:1788620189.461540:0:20428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788620189.462070:0:20428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788620189.462108:0:20428:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788620189.462121:0:20428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbb0e330328bbfa7c 00000100:00080000:1.0:1788620189.462132:0:20428:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788620189.462149:0:20428:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff933393078800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788620189.462185:0:20428:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bd0aca80 x1875503677045120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620189.462219:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677045120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788620189.462291:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788620189.462351:0:20428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788620189.462394:0:496:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788620189.462398:0:496:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788620189.462401:0:496:0:(import.c:65:import_set_state_nolock()) ffff933385841800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788620189.462412:0:496:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:1.0:1788620189.462416:0:496:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788620189.462420:0:496:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff933385841800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:1.0:1788620189.462433:0:496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9333bd0ac380 x1875503677045376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788620189.462477:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677045248:0@lo:400:kworker.0 00000100:00100000:1.0:1788620189.462506:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620189.462529:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620189.462535:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503677045504:0@lo:400:kworker.0 00000100:00100000:1.0:1788620189.462556:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620189.462582:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677045632:0@lo:400:kworker.0 00000100:00100000:1.0:1788620189.462704:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620189.462741:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677045248 00000100:00100000:1.0:1788620189.462748:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677045248 00000100:00100000:1.0:1788620189.462819:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620189.462828:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677045248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620189.462877:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677045248:12345-0@lo:400:kworker.0 Request processed in 49us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.462884:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788620189.462903:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677045120 00000100:00100000:1.0:1788620189.462907:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677045120 00000100:00100000:1.0:1788620189.462920:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677045504 00000100:00100000:1.0:1788620189.462922:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677045504 00000100:00100000:1.0:1788620189.462936:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677045632 00000100:00100000:1.0:1788620189.462938:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677045632 00000100:00100000:1.0:1788620189.462956:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620189.462962:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503677045504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620189.463000:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875503677045504:12345-0@lo:400:kworker.0 Request processed in 38us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.463007:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620189.463019:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788620189.463025:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677045632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620189.463055:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677045632:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.463060:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788620189.463072:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620189.463076:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1875503677045120:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788620189.463096:0:19017:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:1.0:1788620189.463126:0:19017:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbb0e330328bbfa83 00000004:00100000:1.0:1788620189.463200:0:19017:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788620189.463230:0:19017:0:(import.c:65:import_set_state_nolock()) ffff9333b94ec000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620189.463260:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875503677045120:12345-0@lo:38:llog_process_th.0 Request processed in 183us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.463267:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788620189.463284:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788620189.463288:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788620189.463312:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd0adc00 x1875503677045632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620189.463325:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677045632:0@lo:400:kworker.0 00010000:00080000:1.0:1788620189.463347:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd0af480 x1875503677045504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620189.463354:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875503677045504:0@lo:400:kworker.0 00000100:00100000:1.0:1788620189.463370:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788620189.463380:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677045248:0@lo:400:kworker.0 00000100:00100000:1.0:1788620189.463397:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677045376:0@lo:8:kworker.0 00000100:00100000:1.0:1788620189.463419:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788620189.463440:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9333bd0aca80 x1875503677045120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788620199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788620189.463448:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788620189.463454:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788620189.463460:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788620189.463465:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788620189.463467:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933393078800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788620189.463472:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875503677045120:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788620189.463687:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677045376 00000100:00100000:3.0:1788620189.463698:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677045376 00000100:00100000:3.0:1788620189.463726:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788620189.463731:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1875503677045376:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788620189.463788:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1875503677045376:12345-0@lo:8:kworker.0 Request processed in 38us (350us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788620189.463794:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788620189.463873:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788620189.463878:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933385841800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788620189.463881:0:3308:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788620189.463884:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677045376:0@lo:8:kworker.0 00000040:00080000:1.0:1788620189.464059:0:20428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:3.0:1788620189.466889:0:20418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788620189.466929:0:20418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788620189.466985:0:20418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff93338cca8400/0xbb0e330328bbfa67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa6e expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.466999:0:20418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff93338cca8400/0xbb0e330328bbfa67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa6e expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788620189.467054:0:20418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788620189.467056:0:20418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788620189.467058:0:20418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620189.467059:0:20418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620189.467060:0:20418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620189.467061:0:20418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620189.467063:0:20418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620189.467065:0:20418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620189.467066:0:20418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788620189.467071:0:20418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788620189.467073:0:20418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788620189.467075:0:20418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788620189.467076:0:20418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788620189.467077:0:20418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788620189.467078:0:20418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788620189.467079:0:20418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788620189.467080:0:20418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788620189.467081:0:20418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788620189.467082:0:20418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788620189.467107:0:20418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788620189.467126:0:20418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677045760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788620189.467356:0:20418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620189.467402:0:20418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc4406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788620189.467514:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677045760 00000100:00100000:0.0:1788620189.467523:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677045760 00000100:00100000:0.0:1788620189.467574:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788620189.467581:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+19:20418:x1875503677045760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788620189.467616:0:19010:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788620189.467629:0:19010:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788620189.511267:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788620189.517642:0:19010:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788620189.517664:0:19010:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788620189.517755:0:19032:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788620189.517761:0:19032:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788620189.517950:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.517974:0:19032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf941 expref: 19 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.517983:0:19032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.518022:0:19032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf941 expref: 19 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.518041:0:19032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf941 expref: 19 pid: 19009 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620189.518056:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19032:1875503677045888:0@lo:104: 00000100:00100000:2.0:1788620189.518122:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620189.518173:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bb90e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788620189.518197:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677045888 00000100:00100000:2.0:1788620189.518204:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677045888 00000100:00100000:2.0:1788620189.518267:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620189.518276:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+3:19032:x1875503677045888:12345-0@lo:104: 00010000:00010000:2.0:1788620189.518302:0:19000:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.518356:0:19000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620189.518363:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+3:19032:x1875503677045888:12345-0@lo:104: Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620189.518369:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620189.518512:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19032:1875503677045888:0@lo:104: 00010000:00010000:1.0:1788620189.518531:0:19032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.518590:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620189.518597:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.518604:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c1ed6600 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:3.0:1788620189.518617:0:19005:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.518625:0:19005:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788620189.518632:0:19005:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620189.518637:0:19005:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788620189.518669:0:19005:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.518675:0:19005:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788620189.518707:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.518715:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333c1ed6600/0xbb0e330328bbf941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf948 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620189.518730:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620189.518731:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620189.518732:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b50befa-471f-4f69-9917-f69b46ba475e:3312:1875503677046016:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620189.518740:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620189.518803:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620189.518826:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677046016 00000100:00100000:1.0:1788620189.518830:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677046016 00010000:00010000:1.0:1788620189.518851:0:19003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf941 expref: 20 pid: 19009 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620189.518884:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620189.518891:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b50befa-471f-4f69-9917-f69b46ba475e+20:3312:x1875503677046016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620189.518902:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620189.518908:0:19003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf941 expref: 20 pid: 19009 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.518922:0:19003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf941 expref: 20 pid: 19009 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.518936:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93338cca9c00/0xbb0e330328bbf948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf941 expref: 20 pid: 19009 timeout: 692 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.518952:0:19003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.518960:0:19003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788620189.518973:0:19003:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003470956s 00010000:00010000:1.0:1788620189.518978:0:19003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.518985:0:19003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.518992:0:19003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.518998:0:19003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.519009:0:19003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620189.519013:0:19003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.519020:0:19003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.519042:0:19003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620189.519065:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620189.519099:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b50befa-471f-4f69-9917-f69b46ba475e+19:3312:x1875503677046016:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620189.519106:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788620189.519140:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b50befa-471f-4f69-9917-f69b46ba475e:3312:1875503677046016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620189.519278:0:19032:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.519285:0:19032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620189.519291:0:19032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc142c00/0xbb0e330328bbfa8a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620189.523349:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+18:20418:x1875503677045760:12345-0@lo:253:mount.lustre.0 Request processed in 55759us (55984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620189.523364:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788620189.523451:0:20418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7b50befa-471f-4f69-9917-f69b46ba475e:20418:1875503677045760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788620189.523467:0:20418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788620189.523471:0:20418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788620189.523472:0:20418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788620189.523473:0:20418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788620189.523475:0:20418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788620189.523476:0:20418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788620189.523477:0:20418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788620189.523479:0:20418:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788620189.523480:0:20418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788620189.523482:0:20418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788620189.523498:0:20418:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788620189.524055:0:20418:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620189.524497:0:20418:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788620189.524697:0:20418:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620189.525163:0:20418:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788620189.525567:0:20418:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788620189.525766:0:20418:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788620189.527103:0:20418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788620189.561876:0:20418:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788620189.561885:0:20418:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788620189.561915:0:20418:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788620189.561969:0:20418:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788620189.561981:0:20418:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788620189.562012:0:20418:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1788620190.407694:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bd0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677046144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620190.407965:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620190.408098:0:19706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677046144 00000100:00100000:1.0:1788620190.408107:0:19706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677046144 00000100:00100000:1.0:1788620190.408160:0:19706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788620190.408183:0:19706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677046144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788620190.408218:0:19706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788620190.412101:0:19706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677046144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3910us (4126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620190.412115:0:19706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620190.413921:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bd0ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677046144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788620190.536836:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788620190.984551:0:19012:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788620190.984558:0:19012:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff933390d8c000 from 11 10000000:01000000:0.0:1788620190.984562:0:19012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788620190.984617:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2000/0xbb0e330328bbfa91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620190.984629:0:19012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2000/0xbb0e330328bbfa91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620190.984640:0:19012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2000/0xbb0e330328bbfa91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620190.984667:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677046272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788620190.984748:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620190.984831:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333874ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1788620190.984857:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677046272 00000100:00100000:3.0:1788620190.984866:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677046272 00000100:00100000:3.0:1788620190.984922:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788620190.984932:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+18:19012:x1875503677046272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620190.984961:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620190.984998:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93338cca8a00/0xbb0e330328bbfa98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbfa91 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620190.985026:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93338cca8a00/0xbb0e330328bbfa98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbfa91 expref: 19 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620190.985038:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93338cca8a00/0xbb0e330328bbfa98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbfa91 expref: 19 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620190.985049:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93338cca8a00, rc 0) 00000100:00100000:3.0:1788620190.985100:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+19:19012:x1875503677046272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620190.985117:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788620190.985587:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677046272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620190.985617:0:19012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2000/0xbb0e330328bbfa91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa98 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620190.985638:0:19012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2000/0xbb0e330328bbfa91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbfa98 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620190.985764:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677046400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788620190.985826:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620190.985861:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933386361240 going to sleep for 11 seconds 00000100:00100000:3.0:1788620190.986355:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677046400 00000100:00100000:3.0:1788620190.986363:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677046400 00000100:00100000:3.0:1788620190.986522:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788620190.986531:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+19:19012:x1875503677046400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788620190.986556:0:19010:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788620190.986578:0:19010:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788620190.986582:0:19010:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788620190.986705:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+19:19012:x1875503677046400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 174us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620190.986714:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788620190.988224:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677046400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788620190.988306:0:19012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788620190.988315:0:19012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2000/0xbb0e330328bbfa91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa98 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620190.988326:0:19012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2000/0xbb0e330328bbfa91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfa98 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620191.558984:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620192.584815:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788620192.907545:0:19048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788620193.607358:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788620194.503980:0:13043:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788620194.503981:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b50befa-471f-4f69-9917-f69b46ba475e:3310:1875503677046528:0@lo:400:kworker.0 00000100:00080000:3.0:1788620194.503986:0:13043:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788620194.503989:0:13043:0:(import.c:65:import_set_state_nolock()) ffff933385841800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788620194.503999:0:13043:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff933385841800 using connection 192.168.203.112@tcp/0@lo 00000100:00100000:3.0:1788620194.504017:0:13043:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff933387039180 x1875503677046784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788620194.504060:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620194.504064:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677046656:0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.504095:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620194.504128:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620194.504130:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677047168:0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.504134:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677046912:0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.504160:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620194.504171:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677046528 00000100:00100000:0.0:1788620194.504177:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677046528 00000100:00100000:3.0:1788620194.504199:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677046784:0@lo:8:kworker.0 00000100:00100000:3.0:1788620194.504221:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620194.504221:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788620194.504231:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:3310:x1875503677046528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.504250:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677046656 00000100:00100000:3.0:1788620194.504253:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677046656 00000100:00100000:0.0:1788620194.504282:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:3310:x1875503677046528:12345-0@lo:400:kworker.0 Request processed in 54us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620194.504288:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677046784 00000100:00100000:0.0:1788620194.504289:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788620194.504291:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677046784 00000100:00100000:3.0:1788620194.504306:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620194.504313:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677046656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.504367:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677046656:12345-0@lo:400:kworker.0 Request processed in 55us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620194.504383:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620194.504396:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620194.504400:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1875503677046784:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788620194.504422:0:19705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 597 last 0 00000100:00100000:2.0:1788620194.504423:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677047040:0@lo:400:kworker.0 00000020:00000080:3.0:1788620194.504448:0:19705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbb0e330328bbfa9f 00000100:00100000:2.0:1788620194.504452:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:3.0:1788620194.504462:0:19705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff933285a84000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788620194.504466:0:19705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788620194.504468:0:19705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788620194.504606:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677046656:0@lo:400:kworker.0 00000100:00100000:0.0:1788620194.504828:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677046912 00000100:00100000:0.0:1788620194.504832:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677046912 00002000:00080000:3.0:1788620194.504845:0:19705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1788620194.504860:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677047040 00000100:00100000:0.0:1788620194.504862:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677047040 00000100:00080000:3.0:1788620194.504872:0:19705:0:(import.c:65:import_set_state_nolock()) ffff933285a86000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620194.504889:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788620194.504894:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677046912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.504909:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875503677046784:12345-0@lo:8:kworker.0 Request processed in 507us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620194.504915:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620194.504926:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677046912:12345-0@lo:400:kworker.0 Request processed in 32us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620194.504931:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788620194.504938:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788620194.504942:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620194.504942:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620194.504947:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677047040:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788620194.504962:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387039180 x1875503677046784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788620219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788620194.504974:0:3308:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00100000:0.0:1788620194.504975:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677047040:12345-0@lo:400:kworker.0 Request processed in 29us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620194.504980:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788620194.504981:0:3308:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788620194.504985:0:3308:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788620194.504987:0:3308:0:(import.c:65:import_set_state_nolock()) ffff933385841800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788620194.505000:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788620194.505005:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875503677046784:0@lo:8:kworker.0 00010000:00080000:0.0:1788620194.505006:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338703b800 x1875503677047040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620194.505015:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677047040:0@lo:400:kworker.0 00010000:00080000:0.0:1788620194.505034:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff93338703aa00 x1875503677046912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788620194.505042:0:19041:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788620194.505042:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677046912:0@lo:400:kworker.0 00000100:00100000:0.0:1788620194.505052:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677047296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620194.505055:0:19041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19041:1875503677047424:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788620194.505080:0:19041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620194.505080:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620194.505094:0:19041:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392956b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620194.505112:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677047296 00000100:00100000:3.0:1788620194.505115:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677047296 00000100:00100000:3.0:1788620194.505144:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788620194.505150:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503677047296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788620194.505169:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620194.505175:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620194.505202:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503677047296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620194.505202:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b50befa-471f-4f69-9917-f69b46ba475e:3310:1875503677046528:0@lo:400:kworker.0 00000100:00100000:3.0:1788620194.505208:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788620194.505220:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677047168 00000100:00100000:0.0:1788620194.505223:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677047168 00000100:00100000:0.0:1788620194.505243:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788620194.505248:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677047168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620194.505291:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677047168:12345-0@lo:400:kworker.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620194.505296:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788620194.505321:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387039f80 x1875503677047168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788620210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788620194.505330:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677047168:0@lo:400:kworker.0 00000100:00080000:3.0:1788620194.505383:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788620194.505387:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788620194.505403:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff933387039180 x1875503677047296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788620210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788620194.505410:0:19040:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788620194.505416:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677047296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620194.505431:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677047424 00000100:00100000:3.0:1788620194.505434:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677047424 00000100:00100000:3.0:1788620194.505464:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620194.505470:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:19041:x1875503677047424:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788620194.505826:0:19040:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 597474052917ns, next at 0ns, rc = 0 00002000:00080000:3.0:1788620194.516178:0:19705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788620194.516191:0:19705:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1788620194.516198:0:19705:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:65) 00002000:00010000:3.0:1788620194.545734:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.545747:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.545765:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.545810:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.545817:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.545838:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.545850:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.545857:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.545877:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.545892:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.545898:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.545905:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.545909:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.545918:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.545935:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546035:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaa6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546056:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.546058:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.546059:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.546635:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.546642:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546653:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.546657:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.546662:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546673:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546681:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546687:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546705:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.546715:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.546725:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546732:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.546737:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546746:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546759:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546767:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.546817:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.546819:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.546821:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.549826:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.549843:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.549860:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.549865:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.549871:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.549898:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.549908:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.549915:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.549933:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.549948:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.549954:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.549962:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.549966:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.549975:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.549990:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.549998:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfab4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.550021:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.550023:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.550025:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.552822:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.552835:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.552850:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.552855:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.552861:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.552875:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.552885:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.552892:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.552915:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.552931:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.552936:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.552957:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.552962:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.552972:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.552990:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.552997:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfabb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.553020:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.553022:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.553024:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.556523:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.556535:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.556551:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.556555:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.556561:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.556586:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.556609:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.556617:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.556640:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.556658:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.556663:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.557886:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.557892:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.557906:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.557924:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.557931:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfac2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.557955:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.557963:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.557966:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.559218:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.559229:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559244:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.559248:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.559255:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559268:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559279:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559288:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559304:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.559316:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.559321:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559330:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.559334:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559354:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559369:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559377:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfac9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.559395:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.559397:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.559399:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.562377:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.562392:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562411:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.562416:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.562422:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562435:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562446:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562467:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562491:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.562508:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.562514:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562520:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.562525:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562534:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562551:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562559:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfad0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.562593:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.562596:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.562598:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.565523:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.565545:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565563:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.565567:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.565587:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565602:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565612:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565620:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565643:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.565656:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.565662:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565682:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.565687:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565696:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565717:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565725:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfad7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.565744:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.565746:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.565748:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.568738:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.568749:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.568765:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.568800:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.568807:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.568821:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.568831:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.568838:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.568867:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788620194.569223:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.569229:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569237:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.569241:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.569245:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569254:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569262:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569269:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569282:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788620194.569291:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788620194.569296:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569303:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.569314:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569324:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569340:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569346:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032d5a77a/0xbb0e330328bbfade lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569362:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.569365:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569371:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.569374:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569381:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569389:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569396:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db6fb45/0xbb0e330328bbfae5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.569412:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.569414:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.569416:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620194.570221:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.573360:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.573373:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.573391:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.573395:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.573402:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.573416:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.573425:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.573433:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.573462:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620194.573617:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620194.573626:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.573635:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620194.573640:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.573649:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.573670:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.573688:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0912ae7/0xbb0e330328bbfaec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.573706:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.573708:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.573710:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.573992:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.573998:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574018:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.574022:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.574027:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574038:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574046:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574053:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574075:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788620194.574466:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.574472:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574481:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.574484:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.574488:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574496:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574515:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574521:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574540:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788620194.574551:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788620194.574555:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574561:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9200 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.574565:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574590:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574602:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574608:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006973ee92/0xbb0e330328bbfaf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574625:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.574633:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574638:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.574641:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574648:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574659:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574666:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006768ad4a/0xbb0e330328bbfafa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.574677:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.574678:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.574680:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.575232:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.576427:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.576437:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576449:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.576453:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.576458:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576480:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576490:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576497:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576510:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.576520:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.576524:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576531:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9c00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.576535:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576543:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576557:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576564:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b6f7835/0xbb0e330328bbfb01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.576602:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.576604:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.576605:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.581276:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.581292:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.581309:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.581314:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.581321:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.581335:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.581345:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.581353:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.581374:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788620194.582243:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.582252:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582273:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.582277:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.582282:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582293:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582302:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582311:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582330:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788620194.582344:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788620194.582350:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582357:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.582362:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582371:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582395:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582403:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026553080/0xbb0e330328bbfb08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582421:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.582425:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582430:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.582433:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582441:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582449:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582456:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009486eca6/0xbb0e330328bbfb0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.582470:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.582471:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.582476:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.582642:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.583440:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.583447:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.583458:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.583462:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.583467:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.583479:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.583489:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.583496:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.583526:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620194.583605:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620194.583613:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.583620:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9a00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620194.583625:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.583634:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.583648:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.583656:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd508ac7/0xbb0e330328bbfb16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.583675:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.583682:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.583684:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.586023:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.586036:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.586052:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.586057:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.586064:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.586091:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.586102:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.586110:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.586133:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620194.586659:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620194.586668:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.586677:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620194.586680:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.586689:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.586707:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.586714:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066a20829/0xbb0e330328bbfb1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.586737:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.586739:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.586740:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788620194.587695:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788620194.588431:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.588440:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.588455:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.588459:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.588465:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.588477:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.588487:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.588503:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.588531:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788620194.588607:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620194.588614:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620194.588622:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca9800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620194.588626:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620194.588634:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620194.588651:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620194.588658:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca65e94e/0xbb0e330328bbfb24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620194.588680:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620194.588682:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620194.588683:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.591059:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.591072:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591098:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.591103:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.591108:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591122:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591131:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591138:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591160:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788620194.591597:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.591604:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591618:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.591622:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.591626:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591637:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591645:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591654:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.591684:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788620194.592104:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.592110:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592118:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.592121:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.592125:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592134:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592154:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592161:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592170:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788620194.592603:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.592610:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592619:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.592622:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.592626:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592637:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592645:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592652:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.592673:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788620194.593111:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.593117:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.593126:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.593130:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.593135:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.593145:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.593154:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.593160:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.593167:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788620194.593555:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.593561:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.593568:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=597s v=(0 0) 00010000:00010000:0.0:1788620194.593822:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788620194.593831:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593839:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93338cca8600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.593844:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593853:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593873:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593881:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e895d7a/0xbb0e330328bbfb2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593909:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788620194.593913:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593927:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfc00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.593930:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593937:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593947:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593954:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e382672f/0xbb0e330328bbfb32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593967:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788620194.593972:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593978:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cf800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.593981:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593988:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.593997:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594009:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bec4d14d/0xbb0e330328bbfb39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594022:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620194.594026:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594032:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cf600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.594035:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594043:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594053:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594059:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f050f37/0xbb0e330328bbfb40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594071:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620194.594074:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594081:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.594089:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594096:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594106:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594114:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009536321b/0xbb0e330328bbfb47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.594127:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620194.594129:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620194.594131:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.594546:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.600831:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.600842:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.600865:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.600878:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.600886:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.600911:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620194.601161:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620194.601169:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601177:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfa00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.601181:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601191:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601208:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601222:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e72bf51b/0xbb0e330328bbfb4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601244:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620194.601246:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620194.601248:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.601538:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.601546:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.601557:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.601561:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.601565:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.601591:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.601601:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.601614:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.601637:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788620194.601816:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620194.601823:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601832:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce600 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.601836:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601845:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601857:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601865:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3feb479/0xbb0e330328bbfb55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.601879:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620194.601881:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620194.601882:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.602073:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.602080:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602088:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.602092:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.602097:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602107:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602115:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602123:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602147:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788620194.602528:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.602535:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602550:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.602553:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.602557:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602567:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602588:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602595:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.602617:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788620194.603020:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.603027:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.603035:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.603038:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.603042:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.603052:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.603070:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.603078:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608219:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788620194.608235:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608250:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfe00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.608255:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608268:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608291:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608300:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d216cada/0xbb0e330328bbfb5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608336:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788620194.608340:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608347:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cec00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.608351:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608358:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608393:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608401:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a8002fa/0xbb0e330328bbfb63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608416:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788620194.608421:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608428:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce400 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:0.0:1788620194.608432:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608440:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608450:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620194.608458:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620194.608459:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788620194.608462:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620194.608531:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.613819:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788620194.613833:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.613838:0:19705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4fc7283/0xbb0e330328bbfb6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620194.614565:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.614585:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.614600:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.614605:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.614612:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.614628:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.614639:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.614664:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.615915:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620194.618122:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620194.618138:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.618152:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620194.618165:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.618178:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.618203:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.618211:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039368f79/0xbb0e330328bbfb71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.618235:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.618236:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.618238:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.619195:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.619206:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619221:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.619226:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.619232:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619245:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619254:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619261:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619279:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788620194.619292:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620194.619297:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619311:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d1800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620194.619316:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619325:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619338:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619346:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe2495b5/0xbb0e330328bbfb78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.619365:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.619367:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620194.619369:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788620194.621592:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788620194.621606:0:19705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.621624:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=597s v=(0 0) 00010000:00010000:3.0:1788620194.621629:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620194.621636:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.621651:0:19705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.623247:0:19705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.623265:0:19705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620194.623288:0:19705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788620194.623853:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620194.623862:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.623871:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0e00 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620194.623876:0:19004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.623887:0:19004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.623907:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.623924:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093a1f5b4/0xbb0e330328bbfb7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620194.623947:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.623949:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620194.623952:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788620194.625744:0:19705:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788620194.628048:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:19041:x1875503677047424:12345-0@lo:5:osp-pre-1-0.0 Request processed in 122568us (122958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620194.628064:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788620194.629305:0:19041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19041:1875503677047424:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788620194.629325:0:19041:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788620194.629402:0:19041:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19041:1875503677047552:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788620194.629447:0:19041:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620194.629493:0:19041:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333874eecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788620194.629540:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677047552 00000100:00100000:2.0:1788620194.629547:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677047552 00000100:00100000:2.0:1788620194.629599:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788620194.629607:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19041:x1875503677047552:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788620194.629646:0:19704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:0.0:1788620194.632960:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620194.637809:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:19041:x1875503677047552:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8195us (8353us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788620194.637821:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788620194.637891:0:19041:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19041:1875503677047552:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788620194.637908:0:19041:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000001:00080000:2.0:1788620195.104995:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788620195.105046:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788620195.527441:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677047680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788620195.527512:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620195.527978:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677047680 00000100:00100000:2.0:1788620195.527987:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677047680 00000100:00100000:2.0:1788620195.528033:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788620195.528041:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677047680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620195.528072:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788620195.528115:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677047680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620195.528122:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788620195.529344:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677047680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788620195.667243:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620196.170217:0:20773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg312-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788620196.683614:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620197.705306:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620198.543109:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620198.543215:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657126912 00000100:00100000:0.0:1788620198.543225:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657126912 00000100:00100000:0.0:1788620198.543276:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:0.0:1788620198.543285:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1875503657126912:12345-192.168.203.12@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788620198.543316:0:19008:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8@192.168.203.12@tcp t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:0.0:1788620198.543344:0:19008:0:(genops.c:1385:class_connect()) connect: client 1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8, cookie 0xbb0e330328bbfb86 00000100:00080000:0.0:1788620198.543479:0:19008:0:(import.c:65:import_set_state_nolock()) ffff933286572800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788620198.543559:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+5:2353:x1875503657126912:12345-192.168.203.12@tcp:250:mount.lustre.0 Request processed in 273us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620198.543568:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 74 00000100:00100000:0.0:1788620198.557622:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620198.557711:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657127040 00000100:00100000:3.0:1788620198.557721:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657127040 00000100:00100000:3.0:1788620198.557822:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:3.0:1788620198.557834:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+5:16771:x1875503657127040:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788620198.557852:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620198.557871:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d1800/0xbb0e330328bbfb8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ae1e expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620198.558002:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d1800/0xbb0e330328bbfb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae1e expref: 6 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620198.558016:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d1800/0xbb0e330328bbfb8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae1e expref: 6 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620198.558038:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1800, rc 0) 00000100:00100000:2.0:1788620198.558101:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+6:16771:x1875503657127040:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 269us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620198.558109:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 75 00000100:00100000:1.0:1788620198.573127:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620198.573489:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657127168 00000100:00100000:2.0:1788620198.573499:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657127168 00000100:00100000:2.0:1788620198.573563:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:2.0:1788620198.573574:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+6:16771:x1875503657127168:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788620198.573896:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+6:16771:x1875503657127168:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 323us (779us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788620198.573905:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 76 00000100:00100000:3.0:1788620198.578151:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620198.578499:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657127296 00000100:00100000:0.0:1788620198.578510:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657127296 00000100:00100000:0.0:1788620198.578584:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788620198.578594:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+6:16771:x1875503657127296:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788620198.578624:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620198.578640:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c3200/0xbb0e330328bbfb94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ae25 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620198.578666:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c3200/0xbb0e330328bbfb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae25 expref: 7 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620198.578677:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c3200/0xbb0e330328bbfb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae25 expref: 7 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620198.578686:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3200, rc 0) 00000100:00100000:0.0:1788620198.578748:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+7:16771:x1875503657127296:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 156us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620198.578755:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 77 00000100:00100000:0.0:1788620198.590822:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620198.590955:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657127424 00000100:00100000:3.0:1788620198.590965:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657127424 00000100:00100000:3.0:1788620198.591018:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:3.0:1788620198.591029:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+7:16771:x1875503657127424:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788620198.591335:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+8:16771:x1875503657127424:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 306us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620198.591344:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 78 00000100:00100000:1.0:1788620198.597130:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620198.597366:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657127552 00000100:00100000:2.0:1788620198.597376:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657127552 00000100:00100000:2.0:1788620198.598209:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:2.0:1788620198.598223:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+8:16771:x1875503657127552:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788620198.598514:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+8:16771:x1875503657127552:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 294us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620198.598521:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 79 00000100:00100000:1.0:1788620198.613457:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620198.613831:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657127680 00000100:00100000:0.0:1788620198.613857:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657127680 00000100:00100000:0.0:1788620198.613915:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:0.0:1788620198.613926:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933388bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+8:16790:x1875503657127680:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788620198.614321:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933388bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+8:16790:x1875503657127680:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 395us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620198.614329:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 80 00000100:00100000:0.0:1788620198.649911:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620198.652309:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657127808 00000100:00100000:2.0:1788620198.652326:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657127808 00000100:00100000:2.0:1788620198.652402:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:2.0:1788620198.652413:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+8:16790:x1875503657127808:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788620198.652738:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+8:16790:x1875503657127808:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 326us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620198.652764:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 81 00000100:00100000:2.0:1788620198.667869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620198.674585:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657127936 00000100:00100000:3.0:1788620198.674601:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657127936 00000100:00100000:3.0:1788620198.674668:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:3.0:1788620198.674678:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+8:16771:x1875503657127936:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788620198.674702:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620198.674719:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d1c00/0xbb0e330328bbfb9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ae4f expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620198.674753:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d1c00/0xbb0e330328bbfb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae4f expref: 9 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620198.674765:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d1c00/0xbb0e330328bbfb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae4f expref: 9 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620198.674805:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1c00, rc 0) 00000100:00100000:3.0:1788620198.674862:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+9:16771:x1875503657127936:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 185us (7003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620198.674869:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 82 00000100:00100000:1.0:1788620198.693944:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620198.694042:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657128064 00000100:00100000:0.0:1788620198.694054:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657128064 00000100:00100000:0.0:1788620198.694119:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:0.0:1788620198.694129:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+9:16771:x1875503657128064:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788620198.694169:0:19008:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788620198.694185:0:19008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788620198.694189:0:19008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788620198.694192:0:19008:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788620198.694195:0:19008:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1788620198.696176:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+9:16771:x1875503657128064:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 2037us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620198.696188:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 83 00000100:00100000:2.0:1788620198.701139:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620198.701332:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657128192 00000100:00100000:0.0:1788620198.701343:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657128192 00000100:00100000:0.0:1788620198.701403:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:0.0:1788620198.701413:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+9:16771:x1875503657128192:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788620198.701430:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620198.701450:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ae56 expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620198.701481:0:19009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae56 expref: 10 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620198.701494:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae56 expref: 10 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620198.701504:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2600, rc 0) 00000100:00100000:0.0:1788620198.701576:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16771:x1875503657128192:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 165us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620198.701583:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 84 00000100:00100000:1.0:1788620198.710261:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620198.710349:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657128320 00000100:00100000:3.0:1788620198.710359:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657128320 00000100:00100000:3.0:1788620198.710414:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:3.0:1788620198.710424:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16771:x1875503657128320:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788620198.710743:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16771:x1875503657128320:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 319us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620198.710751:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 85 00000100:00100000:1.0:1788620198.713404:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620198.713489:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657128448 00000100:00100000:3.0:1788620198.713499:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657128448 00000100:00100000:3.0:1788620198.713561:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:3.0:1788620198.713572:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16771:x1875503657128448:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788620198.713903:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16771:x1875503657128448:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 332us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620198.713912:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 86 00000100:00100000:2.0:1788620198.719284:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620198.719387:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657128576 00000100:00100000:0.0:1788620198.719397:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657128576 00000100:00100000:0.0:1788620198.719455:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:0.0:1788620198.719465:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16794:x1875503657128576:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788620198.719816:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16794:x1875503657128576:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 350us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620198.719824:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 87 00000100:00100000:1.0:1788620198.727472:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:3.0:1788620198.727863:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620198.738101:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657128704 00000100:00100000:0.0:1788620198.738116:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657128704 00000100:00100000:0.0:1788620198.738192:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:0.0:1788620198.738203:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16794:x1875503657128704:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788620198.738464:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16794:x1875503657128704:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 262us (11000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620198.738473:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 88 00000100:00100000:1.0:1788620198.759443:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620198.759705:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657128832 00000100:00100000:0.0:1788620198.759716:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657128832 00000100:00100000:0.0:1788620198.759764:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:0.0:1788620198.759807:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1875503657128832:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788620198.759847:0:19017:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 650abbe2-2298-4f6c-8c17-cc86374bb18c@192.168.203.12@tcp t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:0.0:1788620198.759904:0:19017:0:(genops.c:1385:class_connect()) connect: client 650abbe2-2298-4f6c-8c17-cc86374bb18c, cookie 0xbb0e330328bbfba9 00000004:00100000:0.0:1788620198.759937:0:19017:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788620198.759944:0:19017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788620198.835383:0:19017:0:(import.c:65:import_set_state_nolock()) ffff933285a87000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620198.835559:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2353:x1875503657128832:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 75783us (76124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620198.835569:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788620198.846424:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620198.846479:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620198.846643:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657129088 00000100:00100000:2.0:1788620198.846653:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657129088 00000100:00100000:2.0:1788620198.846729:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657128960 00000100:00100000:2.0:1788620198.846733:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657128960 00000100:00100000:2.0:1788620198.846763:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788620198.846800:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:16771:x1875503657129088:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788620198.846851:0:19016:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261254144 avail 2259156992 00000100:00100000:2.0:1788620198.846935:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:16771:x1875503657129088:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 163us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620198.846943:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:2.0:1788620198.846961:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788620198.846968:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:0:x1875503657128960:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788620198.846980:0:19016:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261254144 avail 2259156992 00000100:00100000:2.0:1788620198.847004:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:0:x1875503657128960:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 36us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620198.847010:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00080000:0.0:1788620198.847279:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620198.853093:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620198.853190:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657129216 00000100:00100000:2.0:1788620198.853200:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657129216 00000100:00100000:2.0:1788620198.853258:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788620198.853268:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:16771:x1875503657129216:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788620198.853354:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:16771:x1875503657129216:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 87us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620198.853375:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788620198.861235:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620198.861286:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620198.861324:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620198.861464:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657129600 00000100:00100000:2.0:1788620198.861474:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657129600 00000100:00100000:2.0:1788620198.861665:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788620198.861677:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:16771:x1875503657129600:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788620198.862719:0:19019:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 972us 00000100:00100000:3.0:1788620198.866599:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657129344 00000100:00100000:3.0:1788620198.866617:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657129344 00000100:00100000:3.0:1788620198.866746:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657129472 00000100:00100000:3.0:1788620198.866751:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657129472 00000100:00100000:3.0:1788620198.866785:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788620198.867305:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875503657129344:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788620198.867348:0:19705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 650abbe2-2298-4f6c-8c17-cc86374bb18c@192.168.203.12@tcp t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:3.0:1788620198.867377:0:19705:0:(genops.c:1385:class_connect()) connect: client 650abbe2-2298-4f6c-8c17-cc86374bb18c, cookie 0xbb0e330328bbfbb0 00002000:00100000:3.0:1788620198.867388:0:19705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 650abbe2-2298-4f6c-8c17-cc86374bb18c/ffff933285a80800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788620198.867412:0:19705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788620198.867963:0:19705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788620198.867996:0:19705:0:(import.c:65:import_set_state_nolock()) ffff933285a81000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620198.868069:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2353:x1875503657129344:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 767us (6781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620198.868261:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788620198.868288:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788620198.868295:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1875503657129472:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788620198.868313:0:19705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 650abbe2-2298-4f6c-8c17-cc86374bb18c@192.168.203.12@tcp t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:3.0:1788620198.868331:0:19705:0:(genops.c:1385:class_connect()) connect: client 650abbe2-2298-4f6c-8c17-cc86374bb18c, cookie 0xbb0e330328bbfbb7 00002000:00100000:3.0:1788620198.868339:0:19705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 650abbe2-2298-4f6c-8c17-cc86374bb18c/ffff933285a82800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788620198.868356:0:19705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788620198.868577:0:19705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788620198.868594:0:19705:0:(import.c:65:import_set_state_nolock()) ffff933285a84800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620198.868621:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2353:x1875503657129472:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 326us (7297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620198.868627:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000004:00200000:3.0:1788620198.889669:0:19019:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788620198.890138:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:16771:x1875503657129600:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 28458us (28909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620198.890168:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788620199.178043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620199.178137:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657129728 00000100:00100000:3.0:1788620199.178148:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657129728 00000100:00100000:3.0:1788620199.178213:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:3.0:1788620199.178223:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:16815:x1875503657129728:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:3.0:1788620199.178243:0:19017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620199.178267:0:19017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbfbbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ae80 expref: -99 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620199.178332:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfbc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620199.178347:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620199.178363:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620199.178400:0:19017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788620199.178404:0:19017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620199.178443:0:19017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620199.178467:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0600/0xbb0e330328bbfbbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae80 expref: 8 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620199.178485:0:19017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae80 expref: 7 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620199.178513:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933385035800) 00010000:00010000:3.0:1788620199.178516:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620199.178520:0:19017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0800, rc 0) 00000100:00100000:3.0:1788620199.178592:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:16815:x1875503657129728:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 370us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620199.178600:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788620199.623058:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677047808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620199.623143:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620199.623239:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620199.623246:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677047936:0@lo:400:kworker.0 00000100:00100000:1.0:1788620199.623278:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620199.623312:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677048320:0@lo:400:kworker.0 00000100:00100000:1.0:1788620199.623337:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620199.623353:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788620199.623358:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677048448:0@lo:400:kworker.0 00000100:00100000:1.0:1788620199.623377:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620199.623422:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677048320 00000100:00100000:1.0:1788620199.623430:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677048320 00000100:00100000:1.0:1788620199.623482:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677048448 00000100:00100000:1.0:1788620199.623486:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677048448 00000100:00100000:1.0:1788620199.623502:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788620199.623510:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677048320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620199.623571:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677048320:12345-0@lo:400:kworker.0 Request processed in 60us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620199.623579:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788620199.623614:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788620199.623620:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677048448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620199.623651:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677048448:12345-0@lo:400:kworker.0 Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620199.623656:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788620199.623673:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620199.623707:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677048448:0@lo:400:kworker.0 00000100:00100000:1.0:1788620199.623717:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677048320:0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.623807:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677047936 00000100:00100000:2.0:1788620199.623812:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677047936 00000100:00100000:2.0:1788620199.623850:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788620199.623857:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+19:3309:x1875503677047936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.623892:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+19:3309:x1875503677047936:12345-0@lo:400:kworker.0 Request processed in 36us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620199.623898:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788620199.624029:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677047936:0@lo:400:kworker.0 00000100:00100000:3.0:1788620199.624175:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677048064:0@lo:400:kworker.0 00000100:00100000:3.0:1788620199.624209:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620199.624239:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620199.624246:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677048192:0@lo:400:kworker.0 00000100:00100000:3.0:1788620199.624268:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620199.624303:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677048192 00000100:00100000:3.0:1788620199.624307:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677048192 00000100:00100000:3.0:1788620199.624329:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788620199.624335:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677048192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620199.624370:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677048192:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620199.624376:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788620199.624401:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677048192:0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.624621:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677048064 00000100:00100000:2.0:1788620199.624626:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677048064 00000100:00100000:2.0:1788620199.624673:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788620199.624680:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677048064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620199.624714:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677048064:12345-0@lo:400:kworker.0 Request processed in 35us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620199.624720:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788620199.624807:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620199.624951:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677048064:0@lo:400:kworker.0 00000100:00100000:0.0:1788620199.625027:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677047808 00000100:00100000:0.0:1788620199.625031:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677047808 00000100:00100000:0.0:1788620199.625182:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788620199.625191:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677047808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620199.625207:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620199.625258:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677047808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620199.625274:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788620199.625318:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788620199.625378:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788620199.625398:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677047808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788620199.751076:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788620200.198762:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 650abbe2-2298-4f6c-8c17-cc86374bb18c 00000100:00100000:1.0:1788620200.647171:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620200.647197:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677048576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620200.647269:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620200.647384:0:19706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677048576 00000100:00100000:0.0:1788620200.647392:0:19706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677048576 00000100:00100000:0.0:1788620200.647447:0:19706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620200.647455:0:19706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677048576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620200.647490:0:19706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788620200.647548:0:19706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677048576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620200.647555:0:19706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788620200.647751:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677048576:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788620200.712011:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 650abbe2-2298-4f6c-8c17-cc86374bb18c 00010000:00010000:3.0:1788620200.776981:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620201.434046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620201.434192:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657129856 00000100:00100000:3.0:1788620201.434202:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657129856 00000100:00100000:3.0:1788620201.434299:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:3.0:1788620201.434310:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:16868:x1875503657129856:12345-192.168.203.12@tcp:41:lfs.0 00000004:00000024:3.0:1788620201.434355:0:19018:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261254144 avail 2259156992 00000100:00100000:3.0:1788620201.434454:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:16868:x1875503657129856:12345-192.168.203.12@tcp:41:lfs.0 Request processed in 145us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620201.434462:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:1.0:1788620201.434926:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620201.441434:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620201.442559:0:19706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657129984 00000100:00100000:3.0:1788620201.442573:0:19706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657129984 00000100:00100000:3.0:1788620201.442802:0:19706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00080000:1.0:1788620201.442811:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788620201.442814:0:19706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:16868:x1875503657129984:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:3.0:1788620201.442839:0:19706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788620201.442937:0:19706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:16868:x1875503657129984:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 125us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620201.442945:0:19706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788620201.446220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620201.446313:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657130112 00000100:00100000:0.0:1788620201.446323:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657130112 00000100:00100000:0.0:1788620201.446397:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:0.0:1788620201.446407:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:16868:x1875503657130112:12345-192.168.203.12@tcp:13:lfs.0 00002000:00000024:0.0:1788620201.446446:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620201.446543:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:16868:x1875503657130112:12345-192.168.203.12@tcp:13:lfs.0 Request processed in 137us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620201.446551:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00080000:1.0:1788620201.446707:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788620201.701322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620201.701601:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657130240 00000100:00100000:2.0:1788620201.701610:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657130240 00000100:00100000:2.0:1788620201.701682:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:2.0:1788620201.701693:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+10:16900:x1875503657130240:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788620201.701710:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620201.701727:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc142400/0xbb0e330328bbfbcc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06ae87 expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620201.701975:0:19009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc142400/0xbb0e330328bbfbcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae87 expref: 11 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620201.701987:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc142400/0xbb0e330328bbfbcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae87 expref: 11 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620201.701996:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142400, rc 0) 00000100:00100000:2.0:1788620201.702060:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16900:x1875503657130240:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 368us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620201.702067:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 90 00000100:00100000:2.0:1788620201.711725:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620201.711947:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657130368 00000100:00100000:1.0:1788620201.711957:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657130368 00000100:00100000:1.0:1788620201.712010:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1788620201.712030:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16900:x1875503657130368:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788620201.712594:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16900:x1875503657130368:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 573us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.712603:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 91 00000100:00100000:1.0:1788620201.720804:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620201.725097:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657130496 00000100:00100000:2.0:1788620201.725114:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657130496 00000100:00100000:2.0:1788620201.725331:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1788620201.725344:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16900:x1875503657130496:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788620201.726161:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16900:x1875503657130496:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 817us (5389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620201.726171:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 92 00000100:00100000:2.0:1788620201.748181:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620201.756953:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657130624 00000100:00100000:3.0:1788620201.756975:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657130624 00000100:00100000:3.0:1788620201.757077:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:3.0:1788620201.757090:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16907:x1875503657130624:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788620201.757577:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16907:x1875503657130624:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 486us (9407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620201.757588:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 93 00000100:00100000:0.0:1788620201.780685:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620201.780816:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657130752 00000100:00100000:2.0:1788620201.780827:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657130752 00000100:00100000:2.0:1788620201.780897:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:2.0:1788620201.780907:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16907:x1875503657130752:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788620201.781195:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16907:x1875503657130752:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 289us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620201.781203:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 94 00000100:00100000:1.0:1788620201.793229:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620201.793644:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657130880 00000100:00100000:3.0:1788620201.793658:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657130880 00000100:00100000:1.0:1788620201.794167:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 95 00000100:00100000:1.0:1788620201.794183:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16900:x1875503657130880:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788620201.794205:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620201.794229:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbfbd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aeb1 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620201.794266:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbfbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb1 expref: 12 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620201.794280:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc18fe00/0xbb0e330328bbfbd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb1 expref: 12 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620201.794290:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18fe00, rc 0) 00000100:00100000:1.0:1788620201.794419:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16900:x1875503657130880:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 240us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.794450:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 95 00010000:00010000:3.0:1788620201.799217:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620201.809349:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620201.809478:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657131008 00000100:00100000:2.0:1788620201.809495:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657131008 00000100:00100000:2.0:1788620201.809954:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:2.0:1788620201.809969:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933286b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16900:x1875503657131008:12345-192.168.203.12@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788620201.810005:0:19009:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788620201.810041:0:19009:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788620201.810045:0:19009:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788620201.810048:0:19009:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788620201.810806:0:19009:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788620201.823093:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933286b51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16900:x1875503657131008:12345-192.168.203.12@tcp:256:mount.lustre.0 Request processed in 13110us (14399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620201.823114:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 96 00000100:00100000:1.0:1788620201.827280:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620201.827413:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657131136 00000100:00100000:2.0:1788620201.827429:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657131136 00000100:00100000:2.0:1788620201.827564:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:2.0:1788620201.827578:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16900:x1875503657131136:12345-192.168.203.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788620201.827606:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620201.827644:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aeb8 expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620201.827687:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb8 expref: 13 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620201.827725:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb8 expref: 13 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620201.827737:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143000, rc 0) 00000100:00100000:2.0:1788620201.827872:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5881450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16900:x1875503657131136:12345-192.168.203.12@tcp:101:mount.lustre.0 Request processed in 297us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620201.827880:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 97 00000100:00100000:3.0:1788620201.832038:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620201.844942:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657131264 00000100:00100000:1.0:1788620201.844968:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657131264 00000100:00100000:1.0:1788620201.845064:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:1.0:1788620201.845076:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16900:x1875503657131264:12345-192.168.203.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788620201.845488:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5883850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16900:x1875503657131264:12345-192.168.203.12@tcp:501:mount.lustre.0 Request processed in 412us (13473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.845498:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 98 00000100:00100000:0.0:1788620201.848584:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620201.848726:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657131392 00000100:00100000:1.0:1788620201.848739:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657131392 00000100:00100000:1.0:1788620201.848819:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:1.0:1788620201.848831:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16900:x1875503657131392:12345-192.168.203.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788620201.849356:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5882850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16900:x1875503657131392:12345-192.168.203.12@tcp:503:mount.lustre.0 Request processed in 525us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.849365:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 99 00000100:00100000:3.0:1788620201.864512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620201.864731:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657131520 00000100:00100000:0.0:1788620201.864746:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657131520 00000100:00100000:0.0:1788620201.864860:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:0.0:1788620201.864872:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16911:x1875503657131520:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788620201.865270:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5881850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16911:x1875503657131520:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 397us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620201.865280:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 100 00000100:00100000:2.0:1788620201.872979:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620201.873072:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657131648 00000100:00100000:1.0:1788620201.873089:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657131648 00000100:00100000:1.0:1788620201.873169:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:1.0:1788620201.873181:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16911:x1875503657131648:12345-192.168.203.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788620201.873516:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5883450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16911:x1875503657131648:12345-192.168.203.12@tcp:502:llog_process_th.0 Request processed in 336us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.873534:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 101 00000100:00100000:2.0:1788620201.886420:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620201.886461:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620201.886495:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620201.886544:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620201.886634:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657132160 00000100:00100000:1.0:1788620201.886639:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657131904 00000100:00100000:3.0:1788620201.886646:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657132160 00000100:00100000:1.0:1788620201.886655:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657131904 00000100:00100000:3.0:1788620201.886712:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657132032 00000100:00100000:3.0:1788620201.886719:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657132032 00000100:00100000:1.0:1788620201.886731:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657131776 00000100:00100000:1.0:1788620201.886740:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657131776 00000100:00100000:3.0:1788620201.886752:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1788620201.886766:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2354:x1875503657132160:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620201.886918:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2354:x1875503657132160:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 154us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620201.886926:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1788620201.886946:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:3.0:1788620201.886953:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2354:x1875503657132032:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620201.886977:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2354:x1875503657132032:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620201.886983:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788620201.887303:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:1.0:1788620201.887336:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:2354:x1875503657131904:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:1.0:1788620201.887433:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:2354:x1875503657131904:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 117us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620201.887542:0:19017:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788620201.887553:0:19017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788620201.893850:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:3.0:1788620201.893866:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1875503657131776:12345-192.168.203.12@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788620201.894039:0:19018:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3e7c429e-d062-4f14-bf7d-b01316b70d9e@192.168.203.12@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:3.0:1788620201.894084:0:19018:0:(genops.c:1385:class_connect()) connect: client 3e7c429e-d062-4f14-bf7d-b01316b70d9e, cookie 0xbb0e330328bbfbe1 00000100:00100000:1.0:1788620201.894273:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000004:00100000:3.0:1788620201.897234:0:19018:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788620201.897399:0:19018:0:(import.c:65:import_set_state_nolock()) ffff9333bf424000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788620201.897483:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:2353:x1875503657131776:12345-192.168.203.12@tcp:38:mount.lustre.0 Request processed in 3617us (10936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620201.897496:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:2.0:1788620201.902379:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620201.902422:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620201.902502:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657132416 00000100:00100000:1.0:1788620201.902512:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657132416 00000100:00100000:1.0:1788620201.902597:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657132288 00000100:00100000:1.0:1788620201.902601:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657132288 00000100:00100000:1.0:1788620201.902622:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788620201.902631:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+7:16900:x1875503657132416:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788620201.902660:0:19016:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261254144 avail 2259156992 00000100:00100000:1.0:1788620201.902746:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+7:16900:x1875503657132416:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.902753:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788620201.902796:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788620201.902805:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:0:x1875503657132288:12345-192.168.203.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788620201.902818:0:19016:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261254144 avail 2259156992 00000100:00100000:1.0:1788620201.902841:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:0:x1875503657132288:12345-192.168.203.12@tcp:41:mount.lustre.0 Request processed in 38us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.902848:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00080000:0.0:1788620201.903051:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788620201.906985:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620201.907062:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657132544 00000100:00100000:1.0:1788620201.907084:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657132544 00000100:00100000:1.0:1788620201.907152:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788620201.907162:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:16900:x1875503657132544:12345-192.168.203.12@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788620201.907254:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387038a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:16900:x1875503657132544:12345-192.168.203.12@tcp:40:mount.lustre.0 Request processed in 94us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.907261:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:1.0:1788620201.917117:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620201.917166:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620201.917206:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620201.917232:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657132672 00000100:00100000:1.0:1788620201.917239:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657132800 00000100:00100000:0.0:1788620201.917242:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657132672 00000100:00100000:1.0:1788620201.917245:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657132800 00000100:00100000:2.0:1788620201.917329:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657132928 00000100:00100000:2.0:1788620201.917333:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657132928 00000100:00100000:2.0:1788620201.917366:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1788620201.917376:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:16900:x1875503657132928:12345-192.168.203.12@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788620201.917449:0:19020:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788620201.917531:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:16900:x1875503657132928:12345-192.168.203.12@tcp:33:mount.lustre.0 Request processed in 145us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620201.917540:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1788620201.917603:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788620201.917610:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875503657132800:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788620201.917634:0:19703:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3e7c429e-d062-4f14-bf7d-b01316b70d9e@192.168.203.12@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:1.0:1788620201.917662:0:19703:0:(genops.c:1385:class_connect()) connect: client 3e7c429e-d062-4f14-bf7d-b01316b70d9e, cookie 0xbb0e330328bbfbe8 00002000:00100000:1.0:1788620201.917684:0:19703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3e7c429e-d062-4f14-bf7d-b01316b70d9e/ffff9333b94ee000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788620201.917695:0:19703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788620201.917977:0:19703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788620201.918009:0:19703:0:(import.c:65:import_set_state_nolock()) ffff9333b94e8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620201.918046:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:2353:x1875503657132800:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 434us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.918054:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788620201.918070:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788620201.918075:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1875503657132672:12345-192.168.203.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788620201.918089:0:19703:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3e7c429e-d062-4f14-bf7d-b01316b70d9e@192.168.203.12@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:1.0:1788620201.918119:0:19703:0:(genops.c:1385:class_connect()) connect: client 3e7c429e-d062-4f14-bf7d-b01316b70d9e, cookie 0xbb0e330328bbfbef 00002000:00100000:1.0:1788620201.918125:0:19703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e7c429e-d062-4f14-bf7d-b01316b70d9e/ffff9333b94eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788620201.918131:0:19703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788620201.918262:0:19703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788620201.918277:0:19703:0:(import.c:65:import_set_state_nolock()) ffff9333b94ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788620201.918305:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:2353:x1875503657132672:12345-192.168.203.12@tcp:8:mount.lustre.0 Request processed in 228us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620201.918312:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000040:00080000:0.0:1788620202.119447:0:19048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788620202.196243:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620202.196338:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657133056 00000100:00100000:2.0:1788620202.196348:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657133056 00000100:00100000:2.0:1788620202.196417:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788620202.196427:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:16932:x1875503657133056:12345-192.168.203.12@tcp:101:mkdir.0 00010000:00010000:2.0:1788620202.196471:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620202.196496:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbfbf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aee2 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620202.196575:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620202.196588:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620202.196603:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620202.196640:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788620202.196643:0:20890:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788620202.196664:0:20890:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620202.196690:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143400/0xbb0e330328bbfbf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee2 expref: 8 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620202.196708:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee2 expref: 7 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620202.196716:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933385035800) 00010000:00010000:2.0:1788620202.196719:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788620202.196723:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142c00, rc 0) 00000100:00100000:2.0:1788620202.196849:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+7:16932:x1875503657133056:12345-192.168.203.12@tcp:101:mkdir.0 Request processed in 423us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620202.196867:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00010000:00010000:3.0:1788620202.824360:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620203.847053:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788620204.280625:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e7c429e-d062-4f14-bf7d-b01316b70d9e 00000001:00100000:2.0:1788620204.280741:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 650abbe2-2298-4f6c-8c17-cc86374bb18c 00000100:00100000:3.0:1788620204.743018:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788620204.743190:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677048832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620204.743276:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620204.743354:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677048832 00000100:00100000:0.0:1788620204.743361:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677048832 00000100:00100000:0.0:1788620204.743416:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788620204.743426:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677048832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620204.743464:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620204.743522:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677048832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620204.743529:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788620204.743549:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620204.743583:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677048832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620204.743923:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677048960:0@lo:400:kworker.0 00000100:00100000:0.0:1788620204.743956:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620204.743987:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677048960 00000100:00100000:0.0:1788620204.743992:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677048960 00000100:00100000:0.0:1788620204.744026:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788620204.744044:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677048960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620204.744098:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677048960:12345-0@lo:400:kworker.0 Request processed in 66us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620204.744105:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788620204.744123:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620204.744142:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677048960:0@lo:400:kworker.0 00000100:00100000:3.0:1788620204.747351:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677049088:0@lo:400:kworker.0 00000100:00100000:3.0:1788620204.747441:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620204.747490:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b50befa-471f-4f69-9917-f69b46ba475e:3311:1875503677048704:0@lo:400:kworker.0 00000100:00100000:3.0:1788620204.747531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620204.747683:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677049088 00000100:00100000:1.0:1788620204.747691:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677049088 00000100:00100000:1.0:1788620204.747749:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788620204.747759:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677049088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620204.747845:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677049088:12345-0@lo:400:kworker.0 Request processed in 88us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620204.747852:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788620204.747950:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677049088:0@lo:400:kworker.0 00000100:00100000:0.0:1788620204.748025:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677048704 00000100:00100000:0.0:1788620204.748029:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677048704 00000100:00100000:0.0:1788620204.748136:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788620204.748144:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:3311:x1875503677048704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620204.748190:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5880850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:3311:x1875503677048704:12345-0@lo:400:kworker.0 Request processed in 46us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620204.748196:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788620204.748275:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b50befa-471f-4f69-9917-f69b46ba475e:3311:1875503677048704:0@lo:400:kworker.0 00000100:00100000:1.0:1788620204.752306:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503677049216:0@lo:400:kworker.0 00000100:00100000:1.0:1788620204.752386:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620204.752529:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677049216 00000100:00100000:2.0:1788620204.752539:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677049216 00000100:00100000:2.0:1788620204.752645:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788620204.752655:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503677049216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.752711:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875503677049216:12345-0@lo:400:kworker.0 Request processed in 58us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620204.752719:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788620204.754241:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875503677049216:0@lo:400:kworker.0 00000100:00100000:0.0:1788620204.754868:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788620204.754886:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677049344:0@lo:400:kworker.0 00000100:00100000:0.0:1788620204.754953:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620204.755363:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677049344 00000100:00100000:2.0:1788620204.755373:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677049344 00000100:00080000:1.0:1788620204.757496:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620204.761622:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788620204.761639:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677049344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620204.761742:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875503677049344:12345-0@lo:400:kworker.0 Request processed in 108us (6788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620204.761749:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788620204.761845:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875503677049344:0@lo:400:kworker.0 00010000:00010000:3.0:1788620204.871575:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788620205.345905:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e7c429e-d062-4f14-bf7d-b01316b70d9e 00000100:00100000:2.0:1788620205.768243:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677049472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788620205.768313:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620205.769405:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677049472 00000100:00100000:0.0:1788620205.769415:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677049472 00000100:00100000:0.0:1788620205.769509:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788620205.769520:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677049472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788620205.769558:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788620205.769631:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677049472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620205.769640:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788620205.769718:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387fced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677049472:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788620205.825629:0:20979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788620205.831442:0:6720:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e7c429e-d062-4f14-bf7d-b01316b70d9e 00010000:00010000:2.0:1788620205.899623:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620206.919470:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620207.013483:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620207.013535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620207.013564:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620207.013584:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620207.013599:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620207.013614:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620207.013648:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620207.013668:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657133440 00000100:00100000:2.0:1788620207.013677:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657133440 00000100:00100000:2.0:1788620207.013728:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657133568 00000100:00100000:2.0:1788620207.013731:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657133568 00000100:00100000:2.0:1788620207.013760:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657133824 00000100:00100000:2.0:1788620207.013763:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657133824 00000100:00100000:2.0:1788620207.013842:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657133952 00000100:00100000:2.0:1788620207.013845:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657133952 00000100:00100000:2.0:1788620207.013863:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788620207.013871:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2355:x1875503657133440:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620207.013936:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2355:x1875503657133440:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 66us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620207.013945:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788620207.013962:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788620207.013969:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2355:x1875503657133568:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620207.013991:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2355:x1875503657133568:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620207.013997:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788620207.014006:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788620207.014011:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2355:x1875503657133824:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620207.014026:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2355:x1875503657133824:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 16us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620207.014032:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788620207.014040:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788620207.014045:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2355:x1875503657133952:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620207.014069:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2355:x1875503657133952:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620207.014076:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788620207.014091:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657133312 00000100:00100000:2.0:1788620207.014094:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657133312 00000100:00100000:2.0:1788620207.014117:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657133696 00000100:00100000:2.0:1788620207.014119:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657133696 00000100:00100000:2.0:1788620207.014134:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788620207.014140:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2355:x1875503657133312:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620207.014162:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2355:x1875503657133312:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 22us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620207.014168:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788620207.014177:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788620207.014182:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:2355:x1875503657133696:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620207.014197:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:2355:x1875503657133696:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 16us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620207.014203:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00080000:2.0:1788620207.014214:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788620207.014218:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788620207.014220:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620207.016661:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657133184 00000100:00100000:0.0:1788620207.016674:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657133184 00000100:00100000:0.0:1788620207.016737:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 103 00000100:00100000:0.0:1788620207.016760:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:2355:x1875503657133184:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620207.016869:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5880450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:2355:x1875503657133184:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 123us (3395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620207.016877:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 103 00010000:00010000:2.0:1788620207.946948:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620208.967110:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788620209.740963:0:21126:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1f3b71b0 20000000:00000080:1.0:1788620209.740981:0:21126:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff933284c5b000 uarg=0000000000000000 20000000:01000000:1.0:1788620209.742807:0:21126:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788620209.742830:0:21126:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788620209.742835:0:21126:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788620209.743870:0:21127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788620209.744068:0:21126:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788620209.750316:0:21126:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788620209.754174:0:21126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754199:0:21126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf8bc expref: 18 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754221:0:21126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbf909 expref: 18 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754227:0:21126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbfa59 expref: 18 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754237:0:21126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae56 expref: 12 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754243:0:21126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb8 expref: 12 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754251:0:21126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754293:0:21126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb8 expref: 12 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754314:0:21126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb8 expref: 12 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620209.754328:0:21126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677049600:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788620209.754444:0:21126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae56 expref: 12 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754453:0:21126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae56 expref: 12 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620209.754461:0:21126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677049728:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788620209.754513:0:21126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbfa59 expref: 18 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754521:0:21126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbfa59 expref: 18 pid: 19008 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620209.754530:0:21126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677049856:0@lo:104: 00000100:00100000:2.0:1788620209.754567:0:21126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788620209.754598:0:21126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf909 expref: 18 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754606:0:21126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf909 expref: 18 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620209.754614:0:21126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677049984:0@lo:104: 00000100:00100000:2.0:1788620209.754634:0:21126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620209.754667:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677049856 00000100:00100000:2.0:1788620209.754674:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677049856 00000100:00100000:2.0:1788620209.754710:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677049984 00000100:00100000:2.0:1788620209.754713:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677049984 00000100:00100000:2.0:1788620209.754726:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788620209.754733:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+4:21126:x1875503677049856:12345-0@lo:104: 00010000:00010000:2.0:1788620209.754746:0:19000:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754816:0:19000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788620209.754823:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+4:21126:x1875503677049856:12345-0@lo:104: Request processed in 90us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620209.754830:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788620209.754854:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788620209.754860:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+3:21126:x1875503677049984:12345-0@lo:104: 00010000:00010000:2.0:1788620209.754869:0:19000:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.754901:0:19000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788620209.754906:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+3:21126:x1875503677049984:12345-0@lo:104: Request processed in 46us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620209.754912:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788620209.754927:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788620209.757901:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.757925:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f200 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620209.757931:0:19004:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.757949:0:19004:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620209.757956:0:19004:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620209.757961:0:19004:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788620209.758016:0:19004:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.758023:0:19004:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620209.758047:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.758074:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc18f200/0xbb0e330328bbfa59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbfa60 expref: -99 pid: 20418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.758093:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788620209.758097:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.758103:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3000 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:2.0:1788620209.758105:0:19004:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.758112:0:19004:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788620209.758117:0:19004:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788620209.758121:0:19004:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788620209.758137:0:19004:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.758142:0:19004:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788620209.758148:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.758153:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc7c3000/0xbb0e330328bbf909 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf910 expref: -99 pid: 19701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.758160:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620209.758168:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620209.758170:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788620209.758202:0:21126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbb0e330328bbf8bc expref: 18 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620209.758215:0:21126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbb0e330328bbf8bc expref: 18 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620209.758229:0:21126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677050368:0@lo:104: 00000100:00100000:2.0:1788620209.758295:0:21126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620209.758333:0:21126:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387548540 going to sleep for 11 seconds 00000100:00100000:2.0:1788620209.758357:0:21126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677049856:0@lo:104: 00000100:00100000:2.0:1788620209.758366:0:21126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677049984:0@lo:104: 00000100:00100000:1.0:1788620209.758714:0:19000:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788620209.758729:0:19000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677050368 00000100:00100000:1.0:1788620209.758735:0:19000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677050368 00000100:00100000:1.0:1788620209.758812:0:19000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620209.758821:0:19000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+3:21126:x1875503677050368:12345-0@lo:104: 00010000:00010000:1.0:1788620209.758833:0:19000:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.758882:0:19000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788620209.758887:0:19000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb4e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7b50befa-471f-4f69-9917-f69b46ba475e+3:21126:x1875503677050368:12345-0@lo:104: Request processed in 68us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620209.758893:0:19000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788620209.758930:0:19004:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788620209.758935:0:19004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.758941:0:19004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142e00 already unused, calling callback (ffffffffc1aabc20) 10000000:00010000:1.0:1788620209.758945:0:19004:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.758953:0:19004:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788620209.758960:0:19004:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788620209.758966:0:19004:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788620209.758992:0:19004:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.758998:0:19004:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788620209.759014:0:19004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.759020:0:19004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.112@tcp lock: ffff9333bc142e00/0xbb0e330328bbf8bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbb0e330328bbf8c3 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.759033:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620209.759035:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788620209.759036:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620209.759043:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788620209.759053:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b50befa-471f-4f69-9917-f69b46ba475e:3310:1875503677050496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788620209.759069:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620209.759080:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b50befa-471f-4f69-9917-f69b46ba475e:3311:1875503677050112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620209.759082:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620209.759106:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620209.759127:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788620209.759128:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677050496 00000100:00100000:1.0:1788620209.759132:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677050496 00000100:00100000:3.0:1788620209.759133:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b50befa-471f-4f69-9917-f69b46ba475e:3311:1875503677050240:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620209.759149:0:19003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf8bc expref: 19 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620209.759154:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620209.759165:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677050112 00000100:00100000:1.0:1788620209.759168:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677050112 00000100:00100000:3.0:1788620209.759180:0:19001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677050240 00010000:00010000:1.0:1788620209.759180:0:19003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbfa59 expref: 20 pid: 19008 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620209.759183:0:19001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677050240 00000100:00100000:1.0:1788620209.759192:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788620209.759195:0:19001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf909 expref: 21 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620209.759198:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b50befa-471f-4f69-9917-f69b46ba475e+21:3310:x1875503677050496:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620209.759207:0:19001:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788620209.759207:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620209.759211:0:19003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf8bc expref: 21 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620209.759212:0:19001:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788620209.759226:0:19002:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788620209.759226:0:19003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf8bc expref: 21 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620209.759237:0:19002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788620209.759242:0:19002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b50befa-471f-4f69-9917-f69b46ba475e+21:3311:x1875503677050112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788620209.759243:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620209.759250:0:19002:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620209.759254:0:19002:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbfa59 expref: 21 pid: 19008 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620209.759263:0:19002:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbfa59 expref: 21 pid: 19008 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620209.759269:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b50befa-471f-4f69-9917-f69b46ba475e+21:3310:x1875503677050496:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (186us total) trans 0 rc 0/0 00010000:00010000:3.0:1788620209.759274:0:19002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc143c00/0xbb0e330328bbfa60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbfa59 expref: 21 pid: 19008 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620209.759276:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788620209.759283:0:19002:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620209.759287:0:19003:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788620209.759294:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788620209.759299:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933284817c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b50befa-471f-4f69-9917-f69b46ba475e+19:3311:x1875503677050240:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620209.759306:0:19002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b50befa-471f-4f69-9917-f69b46ba475e+19:3311:x1875503677050112:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (200us total) trans 0 rc 0/0 00010000:00010000:1.0:1788620209.759307:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620209.759312:0:19003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbb0e330328bbf909 expref: 19 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620209.759313:0:19002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788620209.759319:0:19003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbb0e330328bbf909 expref: 18 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.759328:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c2400/0xbb0e330328bbf910 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf909 expref: 18 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.759337:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620209.759359:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933284817c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b50befa-471f-4f69-9917-f69b46ba475e+17:3311:x1875503677050240:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620209.759364:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788620209.759409:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b50befa-471f-4f69-9917-f69b46ba475e:3311:1875503677050240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788620209.759409:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b50befa-471f-4f69-9917-f69b46ba475e:3310:1875503677050496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788620209.759417:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b50befa-471f-4f69-9917-f69b46ba475e:3311:1875503677050112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788620209.760084:0:21126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c2a00/0xbb0e330328bbf8c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbb0e330328bbf8bc expref: 16 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620209.760097:0:21126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677050368:0@lo:104: 00000100:00100000:2.0:1788620209.766513:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620209.766971:0:21126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677049600:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788620209.766984:0:21126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1ed8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21126:1875503677049728:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788620209.767156:0:19002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657134208 00000100:00100000:3.0:1788620209.767164:0:19002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657134208 00010000:00010000:3.0:1788620209.767201:0:19002:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae56 expref: 13 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620209.767261:0:21126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620209.767341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620209.767455:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657134080 00000100:00100000:1.0:1788620209.767460:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657134080 00010000:00010000:1.0:1788620209.767497:0:19003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb8 expref: 14 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620209.767570:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788620209.767579:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+14:2354:x1875503657134208:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620209.767595:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620209.767601:0:19003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae56 expref: 14 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767611:0:19003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae56 expref: 14 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767641:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc7c2600/0xbb0e330328bbfba2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae56 expref: 14 pid: 19009 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767655:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620209.767719:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:2354:x1875503657134208:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 140us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620209.767727:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:1.0:1788620209.767744:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788620209.767751:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:2355:x1875503657134080:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620209.767759:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620209.767764:0:19003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb8 expref: 12 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767812:0:19003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb8 expref: 12 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767837:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc143000/0xbb0e330328bbfbda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aeb8 expref: 12 pid: 19010 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767849:0:19003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767857:0:19003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767871:0:19003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767878:0:19003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767886:0:19003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767892:0:19003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767898:0:19003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:1.0:1788620209.767902:0:19003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767910:0:19003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767923:0:19003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620209.767945:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620209.767968:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:2355:x1875503657134080:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 217us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620209.767975:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00010000:00010000:0.0:1788620209.768366:0:21126:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620209.768375:0:21126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620209.768382:0:21126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9333bc142800/0xbb0e330328bbfc04 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620209.862900:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677050624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620209.862976:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620209.863051:0:19706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677050624 00000100:00100000:0.0:1788620209.863058:0:19706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677050624 00000100:00100000:0.0:1788620209.863112:0:19706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788620209.863122:0:19706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677050624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788620209.863155:0:19706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620209.863194:0:19706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875503677050624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620209.863208:0:19706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788620209.863227:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788620209.863264:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875503677050624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788620209.865000:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677050752:0@lo:400:kworker.0 00000100:00100000:0.0:1788620209.865138:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933387039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677051008:0@lo:400:kworker.0 00000100:00100000:0.0:1788620209.865192:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620209.865226:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788620209.865232:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677051136:0@lo:400:kworker.0 00000100:00100000:0.0:1788620209.865252:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620209.865280:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677051008 00000100:00100000:0.0:1788620209.865286:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677051008 00000100:00100000:0.0:1788620209.865342:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677051136 00000100:00100000:0.0:1788620209.865345:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677051136 00000100:00100000:0.0:1788620209.865368:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788620209.865376:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677051008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620209.865425:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875503677051008:12345-0@lo:400:kworker.0 Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620209.865431:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788620209.865461:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788620209.865477:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677051136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620209.865503:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677051136:12345-0@lo:400:kworker.0 Request processed in 37us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620209.865509:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788620209.865534:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788620209.865560:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc121180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677051136:0@lo:400:kworker.0 00000100:00100000:0.0:1788620209.865572:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933387039c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875503677051008:0@lo:400:kworker.0 00000100:00100000:3.0:1788620209.866008:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620209.866033:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620209.866042:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677050880:0@lo:400:kworker.0 00000100:00100000:3.0:1788620209.866066:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620209.866157:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677050752 00000100:00100000:3.0:1788620209.866162:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677050752 00000100:00100000:3.0:1788620209.866200:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620209.866207:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677050752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620209.866244:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677050752:12345-0@lo:400:kworker.0 Request processed in 39us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620209.866251:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788620209.866280:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677050752:0@lo:400:kworker.0 00000100:00080000:0.0:1788620209.867530:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620209.867556:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677050880 00000100:00100000:0.0:1788620209.867564:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677050880 00000100:00100000:0.0:1788620209.867605:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788620209.867613:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677050880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620209.867692:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677050880:12345-0@lo:400:kworker.0 Request processed in 80us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620209.867699:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788620209.867737:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677050880:0@lo:400:kworker.0 00010000:00010000:1.0:1788620209.990947:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620210.890942:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620210.890988:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677051264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620210.891095:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620210.891660:0:19706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677051264 00000100:00100000:2.0:1788620210.891670:0:19706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677051264 00000100:00100000:2.0:1788620210.891847:0:19706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788620210.891856:0:19706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677051264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620210.891893:0:19706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788620210.891965:0:19706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875503677051264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620210.891972:0:19706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788620210.892914:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333c1edaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677051264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788620211.015130:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620211.041687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620211.041799:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657134336 00000100:00100000:3.0:1788620211.041808:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657134336 00000100:00100000:3.0:1788620211.041867:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:3.0:1788620211.041876:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+11:16786:x1875503657134336:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620211.041894:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620211.041912:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbfc0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aee9 expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.041954:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbfc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee9 expref: 12 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.041967:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d1200/0xbb0e330328bbfc0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee9 expref: 12 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.041977:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d1200, rc 0) 00000100:00100000:3.0:1788620211.042047:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5882050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16786:x1875503657134336:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 173us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620211.042054:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 104 00000100:00100000:0.0:1788620211.046971:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620211.047054:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657134464 00000100:00100000:2.0:1788620211.047074:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657134464 00000100:00100000:2.0:1788620211.047120:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:2.0:1788620211.047130:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16786:x1875503657134464:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620211.047565:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5882450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16786:x1875503657134464:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 435us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620211.047574:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 105 00000100:00100000:2.0:1788620211.053951:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.054197:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657134592 00000100:00100000:0.0:1788620211.054208:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657134592 00000100:00100000:0.0:1788620211.054266:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:0.0:1788620211.054284:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16786:x1875503657134592:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620211.054540:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5882c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16786:x1875503657134592:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 265us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620211.054549:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 106 00000100:00100000:1.0:1788620211.065766:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620211.066026:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657134720 00000100:00100000:2.0:1788620211.066036:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657134720 00000100:00100000:2.0:1788620211.066091:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:2.0:1788620211.066102:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+12:16786:x1875503657134720:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620211.066118:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620211.066136:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc143400/0xbb0e330328bbfc12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aef0 expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.066164:0:19009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc143400/0xbb0e330328bbfc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aef0 expref: 13 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.066176:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc143400/0xbb0e330328bbfc12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aef0 expref: 13 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.066186:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143400, rc 0) 00000100:00100000:2.0:1788620211.066242:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5883050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16786:x1875503657134720:12345-192.168.203.12@tcp:101:ll_cfg_requeue.0 Request processed in 142us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620211.066254:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 107 00000100:00100000:1.0:1788620211.069975:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620211.071531:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657134848 00000100:00100000:3.0:1788620211.071560:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657134848 00000100:00100000:3.0:1788620211.071632:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 108 00000100:00100000:3.0:1788620211.071642:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16786:x1875503657134848:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.071952:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5880c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16786:x1875503657134848:12345-192.168.203.12@tcp:501:ll_cfg_requeue.0 Request processed in 309us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620211.071962:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 108 10000000:01000000:3.0:1788620211.081216:0:19012:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788620211.081224:0:19012:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9333bd31c800 from 10 10000000:01000000:3.0:1788620211.081230:0:19012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620211.081290:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c20d0600/0xbb0e330328bbfc19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.081302:0:19012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c20d0600/0xbb0e330328bbfc19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.081313:0:19012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c20d0600/0xbb0e330328bbfc19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620211.081339:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.081515:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620211.081574:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc390300 going to sleep for 11 seconds 00000100:00100000:1.0:1788620211.081738:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.081984:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677051392 00000100:00100000:0.0:1788620211.081999:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677051392 00000100:00100000:0.0:1788620211.082041:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657134976 00000100:00100000:0.0:1788620211.082044:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657134976 00000100:00100000:0.0:1788620211.082057:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788620211.082064:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+16:19012:x1875503677051392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788620211.082077:0:19008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620211.082090:0:19008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc7c2e00/0xbb0e330328bbfc20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbfc19 expref: -99 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.082129:0:19008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc7c2e00/0xbb0e330328bbfc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbfc19 expref: 17 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.082140:0:19008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc7c2e00/0xbb0e330328bbfc20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbfc19 expref: 17 pid: 19008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.082148:0:19008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2e00, rc 0) 00000100:00100000:0.0:1788620211.082195:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5881c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+17:19012:x1875503677051392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620211.082201:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788620211.082226:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 110 00000100:00100000:0.0:1788620211.082232:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16786:x1875503657134976:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620211.082471:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc121f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788620211.082487:0:19012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c20d0600/0xbb0e330328bbfc19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfc20 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620211.082497:0:19012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c20d0600/0xbb0e330328bbfc19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbfc20 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620211.082551:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620211.082578:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620211.082594:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bf412180 going to sleep for 11 seconds 00000100:00100000:2.0:1788620211.082649:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677051520 00000100:00100000:2.0:1788620211.082654:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677051520 00000100:00100000:2.0:1788620211.082686:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788620211.082692:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+17:19012:x1875503677051520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788620211.082930:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5881050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+17:19012:x1875503677051520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620211.082936:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788620211.083005:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788620211.083032:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788620211.083066:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620211.083090:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bf412180 going to sleep for 11 seconds 00000100:00100000:2.0:1788620211.083519:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677051648 00000100:00100000:2.0:1788620211.083524:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677051648 00000100:00100000:2.0:1788620211.083541:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788620211.083546:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333a5880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+17:19012:x1875503677051648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788620211.083643:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5880050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+17:19012:x1875503677051648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620211.083649:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788620211.083703:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338715df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620211.084382:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333a5883c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:16786:x1875503657134976:12345-192.168.203.12@tcp:503:ll_cfg_requeue.0 Request processed in 2144us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620211.084391:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 110 00000040:00080000:2.0:1788620211.087505:0:21142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788620211.088233:0:19012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788620211.088259:0:19012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788620211.088270:0:19012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c20d0600/0xbb0e330328bbfc19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfc20 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.088293:0:19012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c20d0600/0xbb0e330328bbfc19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfc20 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788620211.088323:0:19012:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788620211.088326:0:19012:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933284da0000 from 10 10000000:01000000:3.0:1788620211.088329:0:19012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788620211.088364:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbfc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.088382:0:19012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbfc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.088392:0:19012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbfc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620211.088419:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.088497:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620211.088533:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc390300 going to sleep for 11 seconds 00000100:00100000:2.0:1788620211.090475:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677051776 00000100:00100000:2.0:1788620211.090490:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677051776 00000100:00100000:2.0:1788620211.090560:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788620211.090570:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+17:19012:x1875503677051776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788620211.090586:0:19009:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620211.090605:0:19009:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333bc142000/0xbb0e330328bbfc2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbfc27 expref: -99 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.090634:0:19009:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333bc142000/0xbb0e330328bbfc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbfc27 expref: 18 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.090645:0:19009:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333bc142000/0xbb0e330328bbfc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbfc27 expref: 18 pid: 19009 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.090671:0:19009:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142000, rc 0) 00000100:00100000:2.0:1788620211.090746:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+18:19012:x1875503677051776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620211.090753:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788620211.091153:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620211.091173:0:19012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbfc27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfc2e expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.091182:0:19012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbfc27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbfc2e expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620211.091268:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.091318:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620211.091353:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc390300 going to sleep for 11 seconds 00000100:00100000:3.0:1788620211.091492:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677051904 00000100:00100000:3.0:1788620211.091497:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677051904 00000100:00100000:3.0:1788620211.091540:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788620211.091547:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+18:19012:x1875503677051904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.092170:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b50befa-471f-4f69-9917-f69b46ba475e+18:19012:x1875503677051904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 622us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620211.092179:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788620211.092260:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc121c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677051904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788620211.092312:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677052032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788620211.092356:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620211.092395:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350900 going to sleep for 11 seconds 00000100:00100000:3.0:1788620211.092548:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677052032 00000100:00100000:3.0:1788620211.092553:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677052032 00000100:00100000:3.0:1788620211.092589:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788620211.092596:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+18:19012:x1875503677052032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.094165:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+18:19012:x1875503677052032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1562us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620211.094177:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788620211.094318:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677052032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788620211.107605:0:21143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788620211.107900:0:19012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788620211.107929:0:19012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620211.107941:0:19012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbfc27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfc2e expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.107971:0:19012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333c20d0200/0xbb0e330328bbfc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfc2e expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788620211.107981:0:19012:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788620211.107984:0:19012:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff933390d8c000 from 10 10000000:01000000:0.0:1788620211.107987:0:19012:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788620211.108023:0:19012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbfc35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.108031:0:19012:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbfc35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.108042:0:19012:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbfc35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620211.108067:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677052160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788620211.108134:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620211.108174:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350900 going to sleep for 11 seconds 00000100:00100000:3.0:1788620211.108257:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677052160 00000100:00100000:3.0:1788620211.108266:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677052160 00000100:00100000:3.0:1788620211.108433:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788620211.108444:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+18:19012:x1875503677052160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620211.108468:0:19010:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620211.108483:0:19010:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9333c20d0a00/0xbb0e330328bbfc3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb0e330328bbfc35 expref: -99 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.108507:0:19010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9333c20d0a00/0xbb0e330328bbfc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbb0e330328bbfc35 expref: 19 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.108518:0:19010:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9333c20d0a00/0xbb0e330328bbfc3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbb0e330328bbfc35 expref: 19 pid: 19010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.108527:0:19010:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0a00, rc 0) 00000100:00100000:3.0:1788620211.108578:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b50befa-471f-4f69-9917-f69b46ba475e+19:19012:x1875503677052160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620211.108586:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788620211.108633:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677052160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788620211.108648:0:19012:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbfc35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfc3c expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.108657:0:19012:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbfc35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbb0e330328bbfc3c expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620211.108708:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677052288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.108733:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620211.108747:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406180 going to sleep for 11 seconds 00000100:00100000:3.0:1788620211.108759:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677052288 00000100:00100000:3.0:1788620211.108762:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677052288 00000100:00100000:3.0:1788620211.108804:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788620211.108811:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:19012:x1875503677052288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.109063:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:19012:x1875503677052288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620211.109069:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788620211.109106:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677052288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.109133:0:19012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677052416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.109169:0:19012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620211.109183:0:19012:0:(client.c:2716:ptlrpc_set_wait()) set ffff933287406180 going to sleep for 11 seconds 00000100:00100000:3.0:1788620211.109193:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677052416 00000100:00100000:3.0:1788620211.109197:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677052416 00000100:00100000:3.0:1788620211.109225:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788620211.109231:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:19012:x1875503677052416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788620211.111551:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:19012:x1875503677052416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2310us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620211.111563:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788620211.118438:0:19012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc121500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7b50befa-471f-4f69-9917-f69b46ba475e:19012:1875503677052416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788620211.119705:0:21144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788620211.119984:0:19012:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788620211.120014:0:19012:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788620211.120025:0:19012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbfc35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfc3c expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.120037:0:19012:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.112@tcp lock: ffff9333bc7c2200/0xbb0e330328bbfc35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbb0e330328bbfc3c expref: -99 pid: 19012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620211.464267:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.464597:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657135104 00000100:00100000:0.0:1788620211.464622:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657135104 00000100:00100000:0.0:1788620211.464702:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:0.0:1788620211.464712:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:17395:x1875503657135104:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620211.464731:0:19016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620211.464756:0:19016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aef7 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.464867:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.464882:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.464897:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.464912:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.464919:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.464925:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465228:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbfc58 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465249:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbfc58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465256:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbfc58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620211.465287:0:19016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788620211.465291:0:19016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620211.465326:0:19016:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbfc58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465346:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465353:0:19016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465360:0:19016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465586:0:19016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620211.465591:0:19016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465599:0:19016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465611:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933385035800) 00010000:00010000:0.0:1788620211.465614:0:19016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620211.465619:0:19016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465625:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465638:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465655:0:19016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465661:0:19016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465666:0:19016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620211.465670:0:19016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465676:0:19016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465685:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff93338385ae00) 00010000:00010000:0.0:1788620211.465688:0:19016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620211.465691:0:19016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465697:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465731:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aef7 expref: 8 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465746:0:19016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3000/0xbb0e330328bbfc58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aef7 expref: 7 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.465753:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93338385aa00) 00010000:00010000:0.0:1788620211.465756:0:19016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620211.465764:0:19016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3000, rc 0) 00000100:00100000:0.0:1788620211.465858:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:17395:x1875503657135104:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 1148us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620211.465867:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00080000:2.0:1788620211.466589:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788620211.477180:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.477281:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657135360 00000100:00100000:0.0:1788620211.477292:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657135360 00000100:00100000:0.0:1788620211.477362:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788620211.477554:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:17395:x1875503657135360:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620211.477574:0:19018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620211.477593:0:19018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc5f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06aefe expref: -99 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.477667:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.477682:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.477694:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.477709:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.477717:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.477724:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.478079:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbfc74 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.478096:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbfc74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.478103:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbfc74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620211.478113:0:19018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788620211.478334:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.478342:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.478349:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.478355:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620211.478359:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480623:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480652:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff93338385aa00) 00010000:00010000:0.0:1788620211.480656:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620211.480662:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480670:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfc66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480687:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480710:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480717:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480723:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620211.480728:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480735:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480743:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff93338385ae00) 00010000:00010000:0.0:1788620211.480745:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620211.480748:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.480753:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfc6d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.481964:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc5f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aefe expref: 10 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.481989:0:19018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2400/0xbb0e330328bbfc74 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aefe expref: 9 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.481997:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93338385ab00) 00010000:00010000:0.0:1788620211.482000:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620211.482012:0:19018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2400, rc 0) 00000100:00100000:0.0:1788620211.482123:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:17395:x1875503657135360:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4573us (4954us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788620211.486628:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788620211.499246:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.499405:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657135488 00000100:00100000:0.0:1788620211.499420:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657135488 00000100:00100000:0.0:1788620211.499504:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:0.0:1788620211.499517:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:17395:x1875503657135488:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788620211.499673:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:17395:x1875503657135488:12345-192.168.203.12@tcp:59:lhsmtool_posix.0 Request processed in 158us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620211.499681:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:1.0:1788620211.565132:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620211.565294:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657135616 00000100:00100000:2.0:1788620211.565308:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657135616 00000100:00100000:2.0:1788620211.565395:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788620211.565408:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:17401:x1875503657135616:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788620211.565435:0:19017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620211.565472:0:19017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbfc82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af05 expref: -99 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.565559:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.565577:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.565591:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.565607:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.565615:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.565647:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566081:0:19017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566090:0:19017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566098:0:19017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566105:0:19017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620211.566109:0:19017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566119:0:19017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566135:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933385035800) 00010000:00010000:2.0:1788620211.566139:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620211.566144:0:19017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566151:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfc89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566166:0:19017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566172:0:19017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566184:0:19017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566190:0:19017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620211.566193:0:19017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566199:0:19017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566207:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff933390117600) 00010000:00010000:2.0:1788620211.566210:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620211.566213:0:19017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566218:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfc90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566261:0:19017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbfc82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af05 expref: 10 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566273:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933385035800) 00010000:00010000:2.0:1788620211.566275:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788620211.566279:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143c00/0xbb0e330328bbfc82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af05 expref: 10 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.566289:0:19017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143c00, rc 0) 00000100:00100000:2.0:1788620211.566749:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:17401:x1875503657135616:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 1340us (1632us total) trans 0 rc 301/301 00000100:00100000:2.0:1788620211.566823:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:1.0:1788620211.584322:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620211.584520:0:19025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657135744 00000100:00100000:2.0:1788620211.584530:0:19025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657135744 00000100:00100000:2.0:1788620211.584585:0:19025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788620211.584595:0:19025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:17401:x1875503657135744:12345-192.168.203.12@tcp:700:lfs.0 00000100:00100000:2.0:1788620211.584718:0:19025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:17401:x1875503657135744:12345-192.168.203.12@tcp:700:lfs.0 Request processed in 120us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620211.584726:0:19025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788620211.587136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.587239:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657136000 00000100:00100000:0.0:1788620211.587249:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657136000 00000100:00100000:0.0:1788620211.587317:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:0.0:1788620211.587327:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:17401:x1875503657136000:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1788620211.587384:0:19016:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620211.587422:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfbc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06ae80 expref: 9 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.587445:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933385035800) 00010000:00010000:0.0:1788620211.587451:0:19016:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620211.587711:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.587727:0:19016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee2 expref: 5 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.587919:0:19016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.587955:0:19016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee2 expref: 5 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.587974:0:19016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee2 expref: 5 pid: 20890 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620211.587990:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:19016:1875503677052544:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788620211.588085:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff933390350900 going to sleep for 11 seconds 00000100:00100000:0.0:1788620211.595045:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:19016:1875503677052544:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788620211.595075:0:19016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620211.604711:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620211.605149:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657136128 00000100:00100000:2.0:1788620211.605161:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657136128 00010000:00010000:2.0:1788620211.605285:0:19003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee2 expref: 6 pid: 20890 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620211.605330:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:2.0:1788620211.605340:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:2355:x1875503657136128:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620211.605356:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620211.605364:0:19003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee2 expref: 6 pid: 20890 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.605384:0:19003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee2 expref: 6 pid: 20890 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.605407:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfbfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06aee2 expref: 6 pid: 20890 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.605425:0:19003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933385035800) 00010000:00010000:2.0:1788620211.605444:0:19003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.605465:0:19003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.605473:0:19003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.605511:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620211.605574:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2355:x1875503657136128:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 236us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620211.605582:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00010000:00010000:1.0:1788620211.606126:0:19016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620211.606138:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620211.606249:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620211.606259:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620211.606269:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788620211.609815:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788620211.612381:0:19016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788620211.612404:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.612415:0:19016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.612423:0:19016:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.612429:0:19016:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620211.612434:0:19016:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.612466:0:19016:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.612482:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff933385035800) 00010000:00010000:0.0:1788620211.612485:0:19016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620211.612490:0:19016:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.612496:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfc97 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620211.613871:0:19016:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2f353e1 reply state 0000000093648382 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620211.613887:0:19016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788620211.613980:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+10:17401:x1875503657136000:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 26652us (26852us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788620211.613987:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00010000:00010000:3.0:1788620211.620189:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.620207:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.620216:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.620223:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620211.620229:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.620237:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.620255:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93338604a500) 00010000:00010000:3.0:1788620211.620258:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620211.620263:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.620269:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfc9e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620211.754138:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.754239:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657136256 00000100:00100000:0.0:1788620211.754250:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657136256 00000100:00100000:0.0:1788620211.754313:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:0.0:1788620211.754323:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:17409:x1875503657136256:12345-192.168.203.12@tcp:101:lctl.0 00010000:00010000:0.0:1788620211.754348:0:19018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620211.754371:0:19018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfca5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af0c expref: -99 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.754438:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfcac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.754481:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfcac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.754492:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfcac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620211.754529:0:19018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788620211.754533:0:19018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620211.754567:0:19018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfcac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.754591:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfca5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af0c expref: 11 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.754607:0:19018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2600/0xbb0e330328bbfcac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af0c expref: 10 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.754616:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788620211.754618:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620211.754621:0:19018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2600, rc 0) 00000100:00100000:0.0:1788620211.754847:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+10:17409:x1875503657136256:12345-192.168.203.12@tcp:101:lctl.0 Request processed in 524us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620211.754855:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788620211.791878:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620211.792225:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657136384 00000100:00100000:3.0:1788620211.792236:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657136384 00000100:00100000:3.0:1788620211.792313:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:3.0:1788620211.792323:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:17410:x1875503657136384:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788620211.792344:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620211.792366:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfcb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af13 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.792434:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbfcba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.792448:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbfcba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.792474:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbfcba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620211.792514:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788620211.792518:0:20890:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620211.792537:0:20890:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbfcba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.792562:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfcb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af13 expref: 7 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.792581:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0e00/0xbb0e330328bbfcba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af13 expref: 6 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.792591:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788620211.792593:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788620211.792596:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0e00, rc 0) 00000100:00100000:3.0:1788620211.792671:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:17410:x1875503657136384:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 349us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620211.792693:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 21 00000100:00100000:1.0:1788620211.795879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.795970:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657136512 00000100:00100000:0.0:1788620211.795988:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657136512 00000100:00100000:0.0:1788620211.796053:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:0.0:1788620211.796064:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:17410:x1875503657136512:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788620211.796084:0:19018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620211.796115:0:19018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfcc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af1a expref: -99 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796177:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796191:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796203:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796217:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796224:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796231:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796318:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfcd6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796325:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfcd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796332:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfcd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620211.796359:0:19018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788620211.796362:0:19018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620211.796377:0:19018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfcd6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796395:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796401:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796408:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796414:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620211.796418:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796425:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796437:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788620211.796440:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620211.796445:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796463:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfcc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796476:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796482:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796487:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796497:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620211.796500:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796507:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796514:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff93338385a800) 00010000:00010000:0.0:1788620211.796517:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620211.796520:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796526:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfccf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796554:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfcc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af1a expref: 8 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796565:0:19018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfcd6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af1a expref: 7 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.796571:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788620211.796573:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620211.796575:0:19018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3e00, rc 0) 00000100:00100000:0.0:1788620211.796636:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e7c429e-d062-4f14-bf7d-b01316b70d9e+7:17410:x1875503657136512:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 575us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620211.796643:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 22 00000100:00100000:2.0:1788620211.802859:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620211.802962:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657136768 00000100:00100000:3.0:1788620211.802975:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657136768 00000100:00100000:3.0:1788620211.803053:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:3.0:1788620211.803064:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+7:17410:x1875503657136768:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788620211.803087:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620211.803107:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfcdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af21 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620211.803220:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788620211.803342:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfcdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af21 expref: 9 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.803357:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788620211.803360:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620211.803365:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfcdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af21 expref: 9 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.803377:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0800, rc 0) 00000100:00100000:3.0:1788620211.803438:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+8:17410:x1875503657136768:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 376us (591us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788620211.803445:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 23 00000100:00100000:1.0:1788620211.812236:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.812339:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657137024 00000100:00100000:0.0:1788620211.812362:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657137024 00000100:00100000:0.0:1788620211.812433:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:0.0:1788620211.812444:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e7c429e-d062-4f14-bf7d-b01316b70d9e+8:17410:x1875503657137024:12345-192.168.203.12@tcp:36:lfs.0 00010000:00010000:0.0:1788620211.812509:0:19018:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620211.812534:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfcd6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af1a expref: 8 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.812552:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788620211.812563:0:19018:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788620211.812586:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.812598:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.812617:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620211.813345:0:19018:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000506e8b34 reply state 00000000bff33044 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620211.813358:0:19018:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788620211.813367:0:19018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788620211.813465:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e7c429e-d062-4f14-bf7d-b01316b70d9e+9:17410:x1875503657137024:12345-192.168.203.12@tcp:36:lfs.0 Request processed in 1012us (1229us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788620211.813474:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 24 00000100:00100000:1.0:1788620211.816480:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00010000:00010000:2.0:1788620211.816580:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.816594:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.816602:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.816608:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620211.816613:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.816621:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.816639:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a800) 00010000:00010000:2.0:1788620211.816655:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788620211.816661:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620211.816668:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfceb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620211.817110:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657137280 00000100:00100000:3.0:1788620211.817121:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657137280 00000100:00100000:3.0:1788620211.817183:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:3.0:1788620211.817195:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+8:17410:x1875503657137280:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788620211.817476:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+9:17410:x1875503657137280:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 282us (1005us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788620211.817484:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788620211.820836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620211.821001:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657137536 00000100:00100000:3.0:1788620211.821013:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657137536 00000100:00100000:3.0:1788620211.821081:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:3.0:1788620211.821091:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+9:17410:x1875503657137536:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:3.0:1788620211.821113:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620211.821132:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfcf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af28 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821202:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821215:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821226:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821239:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821245:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821252:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620211.821361:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788620211.821477:0:20890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821485:0:20890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821491:0:20890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821497:0:20890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333c20d0000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620211.821501:0:20890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821507:0:20890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821519:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788620211.821523:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620211.821528:0:20890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821534:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0000/0xbb0e330328bbfcf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821546:0:20890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821551:0:20890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821556:0:20890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821573:0:20890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cec00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620211.821576:0:20890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821582:0:20890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821590:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff933385035300) 00010000:00010000:3.0:1788620211.821593:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620211.821595:0:20890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821601:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821638:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfcf2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af28 expref: 11 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821647:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788620211.821649:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620211.821652:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333c20d0800/0xbb0e330328bbfcf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af28 expref: 11 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.821660:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333c20d0800, rc 0) 00000100:00100000:3.0:1788620211.821812:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+10:17410:x1875503657137536:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 721us (986us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788620211.821820:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 25 00000100:00100000:2.0:1788620211.836875:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.836955:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657137664 00000100:00100000:0.0:1788620211.836965:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657137664 00000100:00100000:0.0:1788620211.837030:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:0.0:1788620211.837047:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e7c429e-d062-4f14-bf7d-b01316b70d9e+10:17410:x1875503657137664:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788620211.837081:0:19017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620211.837104:0:19017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfd0e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af2f expref: -99 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.837191:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.837204:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.837216:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620211.837239:0:19017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788620211.837242:0:19017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620211.837256:0:19017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.837280:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfd0e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af2f expref: 12 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.837297:0:19017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af2f expref: 11 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.837306:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788620211.837309:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620211.837312:0:19017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3600, rc 0) 00000100:00100000:0.0:1788620211.837374:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e7c429e-d062-4f14-bf7d-b01316b70d9e+11:17410:x1875503657137664:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 329us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620211.837389:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:1.0:1788620211.843098:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620211.843170:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657137792 00000100:00100000:3.0:1788620211.843192:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657137792 00000100:00100000:3.0:1788620211.843245:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:3.0:1788620211.843263:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+11:17410:x1875503657137792:12345-192.168.203.12@tcp:37:lfs.0 00000100:00100000:2.0:1788620211.849519:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+11:17410:x1875503657137792:12345-192.168.203.12@tcp:37:lfs.0 Request processed in 6254us (6481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620211.849534:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:1.0:1788620211.858344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620211.861715:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657138048 00000100:00100000:2.0:1788620211.861732:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657138048 00000100:00100000:2.0:1788620211.861829:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:2.0:1788620211.861842:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd337850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e7c429e-d062-4f14-bf7d-b01316b70d9e+11:17410:x1875503657138048:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788620211.862467:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd337850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e7c429e-d062-4f14-bf7d-b01316b70d9e+12:17410:x1875503657138048:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 608us (4114us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788620211.862478:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 4 00000100:00100000:1.0:1788620211.984968:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620211.985229:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657138176 00000100:00100000:3.0:1788620211.985241:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657138176 00000100:00100000:3.0:1788620211.985316:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788620211.985327:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+10:17416:x1875503657138176:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788620211.985349:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620211.985373:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af36 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985441:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985467:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985480:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985497:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985504:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985510:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985630:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbfd31 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985654:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbfd31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985662:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbfd31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620211.985695:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788620211.985699:0:20890:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620211.985738:0:20890:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbfd31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985751:0:20890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985758:0:20890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985765:0:20890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985813:0:20890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cfe00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620211.985827:0:20890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985836:0:20890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985850:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:3.0:1788620211.985853:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620211.985857:0:20890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985874:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfd23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985888:0:20890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985894:0:20890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985899:0:20890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985904:0:20890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620211.985907:0:20890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985913:0:20890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985920:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff933385035300) 00010000:00010000:3.0:1788620211.985922:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620211.985925:0:20890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985931:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfd2a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985961:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af36 expref: 12 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985988:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfa00/0xbb0e330328bbfd31 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af36 expref: 11 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620211.985995:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:3.0:1788620211.985997:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788620211.986000:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfa00, rc 0) 00000100:00100000:2.0:1788620211.986504:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+11:17416:x1875503657138176:12345-192.168.203.12@tcp:101:bash.0 Request processed in 1176us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620211.986513:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788620211.995392:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620211.995934:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657138432 00000100:00100000:0.0:1788620211.995945:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657138432 00000100:00100000:0.0:1788620211.996012:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 28 00000100:00100000:0.0:1788620211.996023:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+11:17416:x1875503657138432:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788620211.996051:0:19017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620211.996072:0:19017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfd38 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af3d expref: -99 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.996190:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.996206:0:19017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af2f expref: 11 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.996216:0:19017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.996260:0:19017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af2f expref: 11 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620211.996280:0:19017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af2f expref: 11 pid: 19017 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620211.996294:0:19017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19017:1875503677052672:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788620211.996396:0:19017:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bc390300 going to sleep for 11 seconds 00000100:00100000:0.0:1788620212.011749:0:19017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19017:1875503677052672:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788620212.011835:0:19017:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620212.013216:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620212.013611:0:21128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657138560 00000100:00100000:1.0:1788620212.013622:0:21128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657138560 00010000:00010000:1.0:1788620212.013666:0:21128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af2f expref: 12 pid: 19017 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620212.013712:0:21128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:1.0:1788620212.013723:0:21128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+12:2357:x1875503657138560:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620212.013739:0:21128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620212.013746:0:21128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af2f expref: 12 pid: 19017 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620212.013765:0:21128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af2f expref: 12 pid: 19017 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620212.013815:0:21128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd15 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af2f expref: 12 pid: 19017 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620212.014085:0:21128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:1.0:1788620212.014090:0:21128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620212.014100:0:21128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620212.014108:0:21128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620212.014134:0:21128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620212.014214:0:21128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+11:2357:x1875503657138560:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 493us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620212.014223:0:21128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00010000:00010000:0.0:1788620212.015442:0:19017:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.015468:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.015499:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.015511:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.015533:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.018976:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019000:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019013:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620212.019032:0:19017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788620212.019082:0:19017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019089:0:19017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019112:0:19017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019118:0:19017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620212.019123:0:19017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019130:0:19017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019143:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788620212.019147:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620212.019151:0:19017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019158:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd3f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788620212.019176:0:19017:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fd4e4bd reply state 0000000046d41db8 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620212.019185:0:19017:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788620212.019231:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfd38 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af3d expref: 14 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019247:0:19017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af3d expref: 13 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.019268:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:0.0:1788620212.019278:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788620212.019281:0:19017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3400, rc 0) 00000100:00100000:0.0:1788620212.019372:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+14:17416:x1875503657138432:12345-192.168.203.12@tcp:101:bash.0 Request processed in 23350us (23990us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788620212.019381:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 28 00010000:00010000:3.0:1788620212.021843:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.021859:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.021866:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.021872:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620212.021877:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.021884:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.021900:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff93338385a200) 00010000:00010000:3.0:1788620212.021903:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620212.021908:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.021936:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd46 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620212.039133:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620212.054217:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620212.054574:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657138688 00000100:00100000:0.0:1788620212.054584:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657138688 00000100:00100000:0.0:1788620212.054647:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788620212.054657:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+13:17416:x1875503657138688:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788620212.054682:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620212.054704:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfd5b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af44 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.054815:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd62 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.055216:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.055229:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620212.055444:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788620212.055459:0:20890:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620212.055481:0:20890:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.055491:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.056059:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfd5b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af44 expref: 15 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.056098:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af44 expref: 14 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.056613:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:0.0:1788620212.056617:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620212.056621:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2a00, rc 0) 00000100:00100000:0.0:1788620212.056710:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+14:17416:x1875503657138688:12345-192.168.203.12@tcp:101:bash.0 Request processed in 2053us (2500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620212.056718:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 29 00000100:00100000:0.0:1788620212.060330:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620212.060432:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657138944 00000100:00100000:3.0:1788620212.060443:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657138944 00000100:00100000:3.0:1788620212.060515:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:3.0:1788620212.060525:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+14:17416:x1875503657138944:12345-192.168.203.12@tcp:35:bash.0 00000100:00100000:3.0:1788620212.064380:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+15:17416:x1875503657138944:12345-192.168.203.12@tcp:35:bash.0 Request processed in 1508us (1712us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788620212.064399:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 5 00000100:00100000:1.0:1788620212.135213:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620212.135372:0:19008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657139072 00000100:00100000:0.0:1788620212.135381:0:19008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657139072 00000100:00100000:0.0:1788620212.135440:0:19008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:0.0:1788620212.135461:0:19008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:2354:x1875503657139072:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620212.135590:0:19008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:2354:x1875503657139072:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 140us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620212.135598:0:19008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 119 00000100:00100000:1.0:1788620212.138436:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620212.138581:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620212.138621:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620212.138644:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620212.140074:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657139328 00000100:00100000:0.0:1788620212.140088:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657139328 00000100:00100000:0.0:1788620212.140147:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657139584 00000100:00100000:0.0:1788620212.140150:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657139584 00000100:00100000:0.0:1788620212.140163:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657139200 00000100:00100000:0.0:1788620212.140165:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657139200 00000100:00100000:0.0:1788620212.140178:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657139456 00000100:00100000:0.0:1788620212.140180:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657139456 00000100:00100000:0.0:1788620212.140200:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788620212.140209:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2354:x1875503657139328:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620212.140465:0:19705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788620212.140476:0:19705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788620212.140491:0:19703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788620212.140500:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788620212.140507:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2354:x1875503657139584:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620212.152929:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2354:x1875503657139328:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 12704us (14486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620212.152948:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788620212.152991:0:19704:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788620212.153010:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:0.0:1788620212.153023:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2354:x1875503657139200:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620212.156021:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2354:x1875503657139584:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 15500us (17425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620212.156037:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788620212.156078:0:19703:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788620212.156092:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788620212.156106:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2354:x1875503657139456:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:0.0:1788620212.156121:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2354:x1875503657139200:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 3101us (17498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620212.156129:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00080000:0.0:1788620212.156159:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788620212.156164:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788620212.156178:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2354:x1875503657139456:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 78us (17533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620212.156184:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788620212.190618:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620212.191896:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657139840 00000100:00100000:0.0:1788620212.191909:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657139840 00000100:00100000:0.0:1788620212.192202:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1788620212.192217:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+15:17426:x1875503657139840:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788620212.192241:0:19018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620212.192261:0:19018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfd69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af4b expref: -99 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620212.192497:0:19018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788620212.192939:0:19018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfd69 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af4b expref: 17 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.192955:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788620212.192958:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788620212.192964:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfd69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af4b expref: 17 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.193056:0:19018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3e00, rc 0) 00000100:00100000:0.0:1788620212.193130:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+16:17426:x1875503657139840:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 917us (2522us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788620212.193139:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 30 00000100:00100000:0.0:1788620212.199091:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620212.199982:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657140096 00000100:00100000:2.0:1788620212.199995:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657140096 00000100:00100000:2.0:1788620212.200090:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:2.0:1788620212.200101:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+16:17426:x1875503657140096:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788620212.200385:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+17:17426:x1875503657140096:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 285us (1303us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788620212.200394:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 6 00000100:00100000:1.0:1788620212.274201:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620212.274284:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657140352 00000100:00100000:2.0:1788620212.274295:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657140352 00000100:00100000:2.0:1788620212.274358:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:2.0:1788620212.274369:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+17:17429:x1875503657140352:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788620212.274394:0:19016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620212.274417:0:19016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfd77 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af52 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620212.274534:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfd7e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620212.274549:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfd7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620212.274562:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfd7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620212.274573:0:19016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788620212.274704:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfd77 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af52 expref: 20 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620212.274734:0:19016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfd7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af52 expref: 19 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620212.274744:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:2.0:1788620212.274760:0:19016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788620212.274764:0:19016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142e00, rc 0) 00000100:00100000:2.0:1788620212.274880:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+19:17429:x1875503657140352:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 511us (690us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788620212.274888:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 31 00000100:00100000:3.0:1788620212.289319:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620212.289415:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657140608 00000100:00100000:2.0:1788620212.289425:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657140608 00000100:00100000:2.0:1788620212.289504:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788620212.289515:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+19:2355:x1875503657140608:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620212.289530:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620212.289556:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142e00/0xbb0e330328bbfd7e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af52 expref: 19 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620212.289576:0:19003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:2.0:1788620212.289581:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620212.289639:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+18:2355:x1875503657140608:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 127us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620212.289647:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:2.0:1788620212.295823:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620212.295914:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657140480 00000100:00100000:3.0:1788620212.295925:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657140480 00000100:00100000:3.0:1788620212.295993:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:3.0:1788620212.296003:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+18:17429:x1875503657140480:12345-192.168.203.12@tcp:54:lfs.0 00010000:00010000:3.0:1788620212.296073:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.296091:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.296103:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.296143:0:19017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.296150:0:19017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.296157:0:19017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.296172:0:19017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cec00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620212.296177:0:19017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.296185:0:19017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.296197:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:3.0:1788620212.296200:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788620212.296220:0:19017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.296226:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfd8c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620212.296304:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+18:17429:x1875503657140480:12345-192.168.203.12@tcp:54:lfs.0 Request processed in 303us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620212.296312:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 32 00000100:00100000:1.0:1788620212.300886:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620212.301000:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657140864 00000100:00100000:2.0:1788620212.301011:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657140864 00000100:00100000:2.0:1788620212.301066:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 7 00000100:00100000:2.0:1788620212.301077:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+18:17429:x1875503657140864:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:2.0:1788620212.301543:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+19:17429:x1875503657140864:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 465us (664us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788620212.301552:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 7 00000040:00080000:1.0:1788620212.361021:0:19048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788620212.785007:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620212.785222:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657141120 00000100:00100000:0.0:1788620212.785232:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657141120 00000100:00100000:0.0:1788620212.785293:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:0.0:1788620212.785303:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+19:17460:x1875503657141120:12345-192.168.203.12@tcp:101:cat.0 00010000:00010000:0.0:1788620212.785338:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620212.785359:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd93 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af59 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.785479:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd9a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.785503:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.785515:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620212.785528:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788620212.785692:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfd93 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af59 expref: 22 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.785710:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd9a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af59 expref: 21 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620212.785734:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:0.0:1788620212.785737:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620212.785740:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3600, rc 0) 00000100:00100000:0.0:1788620212.785880:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+21:17460:x1875503657141120:12345-192.168.203.12@tcp:101:cat.0 Request processed in 578us (882us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788620212.785888:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 33 00000100:00100000:3.0:1788620212.790792:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620212.790847:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620212.790961:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657141376 00000100:00100000:2.0:1788620212.790971:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657141376 00000100:00100000:1.0:1788620212.791035:0:19001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657141504 00000100:00100000:1.0:1788620212.791040:0:19001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657141504 00000100:00100000:2.0:1788620212.791042:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:2.0:1788620212.791055:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+22:17460:x1875503657141376:12345-192.168.203.12@tcp:35:cat.0 00000100:00100000:1.0:1788620212.791100:0:19001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:1.0:1788620212.791110:0:19001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+22:2357:x1875503657141504:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620212.791122:0:19001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620212.791146:0:19001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfd9a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af59 expref: 22 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620212.791167:0:19001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:1.0:1788620212.791172:0:19001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620212.791227:0:19001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+22:2357:x1875503657141504:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 119us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620212.791237:0:19001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 1 00000100:00100000:2.0:1788620212.791316:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+21:17460:x1875503657141376:12345-192.168.203.12@tcp:35:cat.0 Request processed in 264us (552us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788620212.791321:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 8 00000100:00100000:1.0:1788620212.945928:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620212.946079:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657141760 00000100:00100000:3.0:1788620212.946090:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657141760 00000100:00100000:3.0:1788620212.946155:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:3.0:1788620212.946165:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+21:17466:x1875503657141760:12345-192.168.203.12@tcp:101:dd.0 00010000:00010000:3.0:1788620212.946190:0:19017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620212.946213:0:19017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfda8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af60 expref: -99 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.946315:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfdaf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.946330:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfdaf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.946342:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfdaf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620212.946355:0:19017:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788620212.946525:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfda8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af60 expref: 24 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.946558:0:19017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfdaf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af60 expref: 23 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.946567:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:3.0:1788620212.946570:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620212.946574:0:19017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cec00, rc 0) 00000100:00100000:3.0:1788620212.946703:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+23:17466:x1875503657141760:12345-192.168.203.12@tcp:101:dd.0 Request processed in 538us (784us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788620212.946710:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 34 00000100:00100000:1.0:1788620212.953066:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620212.953214:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657141888 00000100:00100000:2.0:1788620212.953224:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657141888 00000100:00100000:2.0:1788620212.953292:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788620212.953303:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+23:2356:x1875503657141888:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620212.953318:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620212.953342:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cec00/0xbb0e330328bbfdaf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af60 expref: 23 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620212.953365:0:19003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:2.0:1788620212.953370:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620212.953430:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+22:2356:x1875503657141888:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620212.953438:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 2 00000100:00100000:2.0:1788620212.955301:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620212.955608:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657142144 00000100:00100000:3.0:1788620212.955618:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657142144 00000100:00100000:3.0:1788620212.955677:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 35 00000100:00100000:3.0:1788620212.955686:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+22:17466:x1875503657142144:12345-192.168.203.12@tcp:36:dd.0 00010000:00010000:3.0:1788620212.955748:0:19016:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620212.955797:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfd62 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af44 expref: 22 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.955815:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:3.0:1788620212.955820:0:19016:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620212.956047:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.956061:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.956071:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788620212.956143:0:19016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788620212.956169:0:19016:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008310ce3f reply state 000000000924e857 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620212.956177:0:19016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620212.956263:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+24:17466:x1875503657142144:12345-192.168.203.12@tcp:36:dd.0 Request processed in 577us (969us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788620212.956271:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 35 00000020:00080000:3.0:1788620212.956275:0:19016:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788620212.959149:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.959165:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.959172:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.959177:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620212.959182:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.959189:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.959205:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:3.0:1788620212.959208:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620212.959213:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620212.959219:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfdbd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.063902:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620213.118411:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620213.119100:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657142400 00000100:00100000:0.0:1788620213.119111:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657142400 00000100:00100000:0.0:1788620213.119182:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00100000:0.0:1788620213.119193:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+23:17466:x1875503657142400:12345-192.168.203.12@tcp:35:dd.0 00000100:00100000:0.0:1788620213.119497:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+24:17466:x1875503657142400:12345-192.168.203.12@tcp:35:dd.0 Request processed in 305us (1095us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788620213.119504:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 9 00000100:00080000:2.0:1788620213.120488:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620213.485311:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620213.485763:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657142528 00000100:00100000:0.0:1788620213.485810:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657142528 00000100:00100000:0.0:1788620213.485875:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:0.0:1788620213.485885:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+24:17480:x1875503657142528:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:0.0:1788620213.485908:0:19018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620213.485928:0:19018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfdc4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af67 expref: -99 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486028:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486043:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486061:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486076:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486084:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486090:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486178:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdd9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486186:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdd9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486193:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdd9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620213.486228:0:19018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788620213.486232:0:19018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620213.486270:0:19018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdd9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486282:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdd9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486290:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486306:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486314:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486319:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620213.486323:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486330:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486343:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788620213.486347:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620213.486351:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486357:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdcb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486370:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486376:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486381:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486385:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620213.486394:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486401:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486408:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff93338385af00) 00010000:00010000:0.0:1788620213.486411:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620213.486414:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486420:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdd2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486468:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfdc4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af67 expref: 26 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486482:0:19018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdd9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af67 expref: 25 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.486489:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:0.0:1788620213.486500:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620213.486503:0:19018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3e00, rc 0) 00000100:00100000:0.0:1788620213.486573:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+25:17480:x1875503657142528:12345-192.168.203.12@tcp:101:stat.0 Request processed in 689us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620213.486580:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 36 00000100:00100000:1.0:1788620213.619891:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620213.621419:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657142784 00000100:00100000:3.0:1788620213.621505:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657142784 00000100:00100000:3.0:1788620213.621645:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 37 00000100:00100000:3.0:1788620213.621657:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+25:17486:x1875503657142784:12345-192.168.203.12@tcp:36:truncate.0 00010000:00010000:3.0:1788620213.621717:0:19016:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788620213.621743:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdd9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af67 expref: 25 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.621763:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:3.0:1788620213.621768:0:19016:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788620213.622015:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.622031:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.622042:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788620213.622093:0:19016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1788620213.622120:0:19016:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce494d8b reply state 00000000686af063 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620213.622130:0:19016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620213.622256:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+27:17486:x1875503657142784:12345-192.168.203.12@tcp:36:truncate.0 Request processed in 600us (2374us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788620213.622263:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 37 00000020:00080000:3.0:1788620213.622279:0:19016:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788620213.627289:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.627309:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.627318:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.627324:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620213.627329:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.627336:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.627352:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:3.0:1788620213.627356:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620213.627361:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620213.627367:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfde0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620213.839325:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620213.839478:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657142912 00000100:00100000:0.0:1788620213.839488:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657142912 00000100:00100000:0.0:1788620213.839557:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:0.0:1788620213.839567:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+26:17500:x1875503657142912:12345-192.168.203.12@tcp:101:stat.0 00010000:00010000:0.0:1788620213.839605:0:19018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620213.839627:0:19018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfde7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af6e expref: -99 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839693:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839708:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839720:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839735:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839742:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839762:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839878:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839888:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839896:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620213.839933:0:19018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788620213.839942:0:19018:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620213.839963:0:19018:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839975:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839983:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839989:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.839995:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840001:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620213.840005:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840013:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840024:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:0.0:1788620213.840027:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620213.840032:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840038:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfdee lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840050:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840070:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840076:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840082:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620213.840085:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840093:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840101:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff93338385af00) 00010000:00010000:0.0:1788620213.840104:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620213.840106:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840112:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfdf5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840147:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfde7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af6e expref: 28 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840161:0:19018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af6e expref: 27 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.840169:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:0.0:1788620213.840172:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788620213.840181:0:19018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3e00, rc 0) 00000100:00100000:0.0:1788620213.840254:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+27:17500:x1875503657142912:12345-192.168.203.12@tcp:101:stat.0 Request processed in 687us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620213.840262:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 38 00000100:00100000:2.0:1788620213.986585:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620213.986740:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657143168 00000100:00100000:0.0:1788620213.986763:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657143168 00000100:00100000:0.0:1788620213.986852:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:0.0:1788620213.986864:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+27:17510:x1875503657143168:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:0.0:1788620213.986883:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620213.986905:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af75 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620213.987123:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788620213.987333:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af75 expref: 29 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.987349:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:0.0:1788620213.987352:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788620213.987357:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af75 expref: 29 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620213.987372:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2800, rc 0) 00000100:00100000:0.0:1788620213.987498:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+28:17510:x1875503657143168:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 636us (923us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1788620213.987506:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 39 00000100:00100000:1.0:1788620214.007915:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.008006:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657143424 00000100:00100000:0.0:1788620214.008015:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657143424 00000100:00100000:0.0:1788620214.008073:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 10 00000100:00100000:0.0:1788620214.008098:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd336850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+28:17510:x1875503657143424:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:0.0:1788620214.008360:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd336850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+29:17510:x1875503657143424:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 264us (454us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788620214.008368:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 10 00010000:00010000:1.0:1788620214.086907:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788620214.133969:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.134067:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657143680 00000100:00100000:0.0:1788620214.134078:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657143680 00000100:00100000:0.0:1788620214.134137:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:0.0:1788620214.134148:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+29:17516:x1875503657143680:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788620214.134172:0:19018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620214.134192:0:19018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe11 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af7c expref: -99 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.134300:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.134315:0:19018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af3d expref: 30 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.134322:0:19018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af6e expref: 30 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.134329:0:19018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.134362:0:19018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af6e expref: 30 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.134380:0:19018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af6e expref: 30 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620214.134406:0:19018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19018:1875503677052800:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788620214.134519:0:19018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af3d expref: 30 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.134528:0:19018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af3d expref: 30 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620214.134537:0:19018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333908a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19018:1875503677052928:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788620214.134560:0:19018:0:(client.c:2716:ptlrpc_set_wait()) set ffff933387426300 going to sleep for 11 seconds 00000100:00100000:2.0:1788620214.138248:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.138359:0:19001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657143808 00000100:00100000:1.0:1788620214.138369:0:19001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657143808 00010000:00010000:1.0:1788620214.138423:0:19001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af6e expref: 31 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.138481:0:19001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:1.0:1788620214.138492:0:19001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:2354:x1875503657143808:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620214.138506:0:19001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620214.138514:0:19001:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af6e expref: 31 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.138532:0:19001:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af6e expref: 31 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.138555:0:19001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:1.0:1788620214.138560:0:19001:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.138568:0:19001:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.138574:0:19001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620214.138644:0:19001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:2354:x1875503657143808:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 154us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620214.138662:0:19001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00010000:00010000:0.0:1788620214.139121:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfdfc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af6e expref: 30 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620214.139137:0:19018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19018:1875503677052800:192.168.203.12@tcp:104: 00000100:00100000:0.0:1788620214.139148:0:19018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333908a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19018:1875503677052928:192.168.203.12@tcp:104: 00010000:00010000:0.0:1788620214.139170:0:19018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620214.141998:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.142142:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657143936 00000100:00100000:1.0:1788620214.142154:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657143936 00010000:00010000:1.0:1788620214.142192:0:19003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af3d expref: 30 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.142236:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788620214.142245:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+30:2354:x1875503657143936:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620214.142259:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620214.142266:0:19003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af3d expref: 30 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.142283:0:19003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af3d expref: 30 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.142304:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfd4d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af3d expref: 30 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.142320:0:19003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:1.0:1788620214.142325:0:19003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.142335:0:19003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.142342:0:19003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.142401:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620214.142471:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+29:2354:x1875503657143936:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 226us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620214.142479:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00010000:00010000:0.0:1788620214.142539:0:19018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.142547:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620214.142568:0:19018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788620214.142752:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe11 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af7c expref: 30 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.142806:0:19018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af7c expref: 29 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.142813:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:0.0:1788620214.142816:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788620214.142819:0:19018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c2a00, rc 0) 00000100:00100000:0.0:1788620214.142847:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+29:17516:x1875503657143680:12345-192.168.203.12@tcp:101:bash.0 Request processed in 8701us (8890us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788620214.142854:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 40 00000100:00100000:3.0:1788620214.149607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620214.149709:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657144192 00000100:00100000:2.0:1788620214.149719:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657144192 00000100:00100000:2.0:1788620214.149810:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 41 00000100:00100000:2.0:1788620214.149821:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+29:17516:x1875503657144192:12345-192.168.203.12@tcp:36:bash.0 00010000:00010000:2.0:1788620214.150102:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.150191:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.150204:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788620214.150263:0:19016:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1788620214.150291:0:19016:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a41f43bf reply state 000000007dce5587 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620214.150299:0:19016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788620214.150393:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+32:17516:x1875503657144192:12345-192.168.203.12@tcp:36:bash.0 Request processed in 573us (805us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1788620214.150401:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 41 00000020:00080000:2.0:1788620214.150407:0:19016:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788620214.154239:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.154256:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.154263:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.154281:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620214.154287:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.154296:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.154312:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:3.0:1788620214.154315:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620214.154319:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.154324:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfe26 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620214.155741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620214.155955:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657144320 00000100:00100000:2.0:1788620214.155972:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657144320 00000100:00100000:2.0:1788620214.156033:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788620214.156044:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:17516:x1875503657144320:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:2.0:1788620214.156065:0:19017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620214.156083:0:19017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfe2d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af83 expref: -99 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.156288:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfe2d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af83 expref: 32 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.156304:0:19017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfe2d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af83 expref: 32 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.156322:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:2.0:1788620214.156325:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788620214.156329:0:19017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142800, rc 0) 00000100:00100000:2.0:1788620214.156501:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+32:17516:x1875503657144320:12345-192.168.203.12@tcp:101:bash.0 Request processed in 458us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.156508:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 42 00000100:00100000:2.0:1788620214.163945:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.164148:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657144448 00000100:00100000:3.0:1788620214.164159:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657144448 00000100:00100000:3.0:1788620214.164222:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:3.0:1788620214.164233:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+32:17516:x1875503657144448:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:3.0:1788620214.164255:0:19016:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620214.164277:0:19016:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfe34 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af8a expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.164393:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.164408:0:19016:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af7c expref: 33 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.164430:0:19016:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.164476:0:19016:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af7c expref: 33 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.164493:0:19016:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af7c expref: 33 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620214.164508:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:19016:1875503677053056:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788620214.164595:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395e17a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788620214.168903:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620214.169003:0:19001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657144576 00000100:00100000:2.0:1788620214.169012:0:19001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657144576 00010000:00010000:2.0:1788620214.169060:0:19001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af7c expref: 34 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620214.169076:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc120e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:19016:1875503677053056:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788620214.169098:0:19001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00010000:00010000:3.0:1788620214.169105:0:19016:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620214.169111:0:19001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+34:2355:x1875503657144576:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788620214.169129:0:19001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788620214.169136:0:19001:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af7c expref: 34 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.169156:0:19001:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af7c expref: 34 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.169192:0:19001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe18 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af7c expref: 34 pid: 19018 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.169208:0:19001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:2.0:1788620214.169213:0:19001:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.169223:0:19001:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.169231:0:19001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.169263:0:19001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620214.169322:0:19001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+33:2355:x1875503657144576:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 215us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.169330:0:19001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00010000:00010000:3.0:1788620214.169507:0:19016:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.169515:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788620214.169562:0:19016:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788620214.169566:0:19016:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788620214.169586:0:19016:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.169624:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfe34 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af8a expref: 33 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.169651:0:19016:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af8a expref: 32 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.169658:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:3.0:1788620214.169661:0:19016:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620214.169663:0:19016:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cfe00, rc 0) 00000100:00100000:3.0:1788620214.169703:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+32:17516:x1875503657144448:12345-192.168.203.12@tcp:101:bash.0 Request processed in 5473us (5770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620214.169710:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 43 00000100:00100000:1.0:1788620214.175168:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620214.175252:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657144832 00000100:00100000:2.0:1788620214.175262:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657144832 00000100:00100000:2.0:1788620214.175328:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788620214.175338:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+32:17516:x1875503657144832:12345-192.168.203.12@tcp:103:bash.0 00010000:00010000:2.0:1788620214.175352:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788620214.175386:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813cfe00/0xbb0e330328bbfe3b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af8a expref: 32 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.175406:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfe2d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af83 expref: 31 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.175444:0:19003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385a000) 00010000:00010000:2.0:1788620214.175456:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620214.175513:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+30:17516:x1875503657144832:12345-192.168.203.12@tcp:103:bash.0 Request processed in 176us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.175519:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 3 00000100:00100000:2.0:1788620214.179027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.179246:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657144960 00000100:00100000:0.0:1788620214.179256:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657144960 00000100:00100000:0.0:1788620214.179358:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:0.0:1788620214.179378:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+30:17516:x1875503657144960:12345-192.168.203.12@tcp:58:bash.0 00010000:00010000:0.0:1788620214.179492:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.179509:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.179521:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788620214.180505:0:19018:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788620214.181147:0:19018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788620214.181277:0:19018:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788620214.181823:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+30:17516:x1875503657144960:12345-192.168.203.12@tcp:58:bash.0 Request processed in 2450us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620214.181849:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 44 00000100:00100000:1.0:1788620214.184974:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.185067:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657145088 00000100:00100000:0.0:1788620214.185077:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657145088 00000100:00100000:0.0:1788620214.185138:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 45 00000100:00100000:0.0:1788620214.185148:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+30:17516:x1875503657145088:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:0.0:1788620214.185170:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620214.185190:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfe49 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af91 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.185257:0:20890:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.185267:0:20890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfe49 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af91 expref: 31 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.185285:0:20890:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.185297:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfe49 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af91 expref: 31 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.185311:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385af00) 00010000:00010000:0.0:1788620214.185314:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620214.185317:0:20890:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfe49 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af91 expref: 31 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.185325:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc7c3e00, rc 0) 00000100:00100000:0.0:1788620214.185401:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:17516:x1875503657145088:12345-192.168.203.12@tcp:101:bash.0 Request processed in 248us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620214.185407:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 45 00000040:00080000:1.0:1788620214.407854:0:19048:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788620214.407864:0:19048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788620214.407920:0:19048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788620214.407928:0:19048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788620214.408072:0:19048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285bf8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19048:1875503677053184:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788620214.408385:0:19048:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333bf412600 going to sleep for 11 seconds 00000100:00100000:2.0:1788620214.413460:0:19048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285bf8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19048:1875503677053184:192.168.203.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788620214.419337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.419963:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657145216 00000100:00100000:3.0:1788620214.419986:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657145216 00000100:00100000:3.0:1788620214.420039:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:3.0:1788620214.420048:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bd0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:17517:x1875503657145216:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788620214.420130:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bd0ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:17517:x1875503657145216:12345-192.168.203.12@tcp:900:lhsmtool_posix.0 Request processed in 83us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620214.420138:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788620214.435172:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620214.435339:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657145344 00000100:00100000:2.0:1788620214.435350:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657145344 00000100:00100000:2.0:1788620214.435414:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:2.0:1788620214.435425:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:17517:x1875503657145344:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788620214.435470:0:19017:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788620214.435594:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:17517:x1875503657145344:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 165us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.435601:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 46 00000100:00100000:1.0:1788620214.447596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.447748:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657145472 00000100:00100000:0.0:1788620214.447759:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657145472 00000100:00100000:0.0:1788620214.447847:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:0.0:1788620214.447857:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:17517:x1875503657145472:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788620214.447942:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.447959:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.447972:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.447990:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448318:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448328:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448353:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448362:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448369:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620214.448426:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788620214.448430:0:20890:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788620214.448453:0:20890:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448465:0:20890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448472:0:20890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448479:0:20890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448486:0:20890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620214.448490:0:20890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448569:0:20890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448582:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93338385ab00) 00010000:00010000:0.0:1788620214.448585:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620214.448590:0:20890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448595:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3600/0xbb0e330328bbfe50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448608:0:20890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448624:0:20890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448630:0:20890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448635:0:20890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2a00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620214.448638:0:20890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448715:0:20890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448724:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff93338385a900) 00010000:00010000:0.0:1788620214.448726:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620214.448729:0:20890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448735:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2a00/0xbb0e330328bbfe57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448752:0:20890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448759:0:20890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448764:0:20890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448769:0:20890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c3400 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620214.448865:0:20890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448872:0:20890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448881:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385af00) 00010000:00010000:0.0:1788620214.448883:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788620214.448887:0:20890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.448892:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3400/0xbb0e330328bbfe5e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620214.448990:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:17517:x1875503657145472:12345-192.168.203.12@tcp:34:lhsmtool_posix.0 Request processed in 1132us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620214.449008:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 47 00000100:00100000:2.0:1788620214.453561:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.454131:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657145728 00000100:00100000:0.0:1788620214.454142:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657145728 00000100:00100000:0.0:1788620214.454205:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:0.0:1788620214.454215:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338715ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+31:17517:x1875503657145728:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620214.454235:0:19018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620214.454256:0:19018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfe65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af98 expref: -99 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454350:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454386:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454416:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788620214.454429:0:19018:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788620214.454543:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454550:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454556:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454561:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff933380030e00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620214.454565:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454572:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454583:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385af00) 00010000:00010000:0.0:1788620214.454586:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788620214.454590:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454595:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfe6c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454631:0:19018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfe65 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af98 expref: 33 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454660:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff93338385ab00) 00010000:00010000:0.0:1788620214.454662:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788620214.454667:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfe65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af98 expref: 33 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.454676:0:19018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031e00, rc 0) 00000100:00100000:0.0:1788620214.454743:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338715ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+32:17517:x1875503657145728:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 529us (1191us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1788620214.454751:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 48 00000100:00100000:2.0:1788620214.458876:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.461356:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657145856 00000100:00100000:3.0:1788620214.461371:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657145856 00000100:00100000:3.0:1788620214.461457:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:3.0:1788620214.461469:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+32:17517:x1875503657145856:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788620214.461526:0:19016:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788620214.461657:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+32:17517:x1875503657145856:12345-192.168.203.12@tcp:53:lhsmtool_posix.0 Request processed in 190us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620214.461665:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 49 00000100:00100000:2.0:1788620214.466290:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.466444:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657146112 00000100:00100000:3.0:1788620214.466454:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657146112 00000100:00100000:3.0:1788620214.466516:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788620214.466528:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+32:17517:x1875503657146112:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620214.466549:0:19017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620214.466569:0:19017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfe7a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06af9f expref: -99 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788620214.467559:0:19017:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:3.0:1788620214.467567:0:19017:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:3.0:1788620214.467621:0:19017:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:3.0:1788620214.470624:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbfe81 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.470649:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbfe81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.470660:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbfe81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.470949:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfe7a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af9f expref: 35 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.470972:0:19017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbfe81 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af9f expref: 34 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.470981:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff933385035300) 00010000:00010000:3.0:1788620214.470984:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788620214.470987:0:19017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813ce000, rc 0) 00000100:00100000:3.0:1788620214.471069:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+34:17517:x1875503657146112:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 4543us (4788us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1788620214.471079:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 50 00000100:00100000:3.0:1788620214.489321:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.489393:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657146368 00000100:00100000:1.0:1788620214.489404:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657146368 00000100:00100000:1.0:1788620214.489473:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788620214.489484:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+34:17517:x1875503657146368:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788620214.489547:0:20890:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620214.489577:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce000/0xbb0e330328bbfe81 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af9f expref: 34 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.489609:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff933385035300) 00010000:00010000:1.0:1788620214.489621:0:20890:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788620214.489646:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.489673:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.489684:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.489701:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.489708:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.489892:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490097:0:20890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490105:0:20890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490112:0:20890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490118:0:20890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620214.490123:0:20890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490135:0:20890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490143:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:1.0:1788620214.490152:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620214.490156:0:20890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490163:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfe8f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490173:0:20890:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490178:0:20890:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490184:0:20890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490188:0:20890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18f600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620214.490190:0:20890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490197:0:20890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490203:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x5b6e4aef (ffff93338604a700) 00010000:00010000:1.0:1788620214.490206:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620214.490208:0:20890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.490213:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f600/0xbb0e330328bbfe96 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5b6e4aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.490310:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+33:17517:x1875503657146368:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 826us (998us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788620214.490322:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 51 00000100:00100000:1.0:1788620214.510218:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.510351:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657146496 00000100:00100000:0.0:1788620214.510362:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657146496 00000100:00100000:0.0:1788620214.510425:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788620214.510447:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+33:17517:x1875503657146496:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620214.510470:0:19018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620214.510497:0:19018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfe9d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06afa6 expref: -99 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.510539:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfea4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.510554:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfea4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.510566:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfea4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.510675:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfe9d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afa6 expref: 35 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.510701:0:19018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933380030e00/0xbb0e330328bbfea4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afa6 expref: 34 pid: 19018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.510710:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93338385a900) 00010000:00010000:0.0:1788620214.510713:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788620214.510716:0:19018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380030e00, rc 0) 00000100:00100000:0.0:1788620214.510823:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+34:17517:x1875503657146496:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 388us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620214.510830:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 52 00000100:00100000:0.0:1788620214.527111:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.528739:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657146752 00000100:00100000:3.0:1788620214.528754:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657146752 00000100:00100000:3.0:1788620214.528854:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 53 00000100:00100000:3.0:1788620214.528865:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+34:17517:x1875503657146752:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788620214.528949:0:20890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.528966:0:20890:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.528978:0:20890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788620214.529820:0:20890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1788620214.529833:0:20890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 617498061011ns, next at 618498058976ns, rc = 0 00000004:00010000:3.0:1788620214.529945:0:20890:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009da7f95e reply state 00000000cab67c35 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620214.529956:0:20890:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788620214.530074:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+36:17517:x1875503657146752:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 1208us (2969us total) trans 12884901917 rc 0/0 00000100:00100000:3.0:1788620214.530083:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 53 00010000:00010000:0.0:1788620214.546688:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.546707:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.546714:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.546721:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813ce600 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:0.0:1788620214.546726:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.546734:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.546750:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93338385a900) 00010000:00010000:0.0:1788620214.546754:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788620214.546789:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.546797:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333813ce600/0xbb0e330328bbfeab lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20890 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620214.546903:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.546932:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657146880 00000100:00100000:0.0:1788620214.546940:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657146880 00000100:00100000:0.0:1788620214.546992:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788620214.547002:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+35:17517:x1875503657146880:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788620214.547024:0:19017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788620214.547042:0:19017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06afad expref: -99 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.547102:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afad expref: 36 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.547115:0:19017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afad expref: 36 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.547134:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93338385a900) 00010000:00010000:0.0:1788620214.547137:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788620214.547139:0:19017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff933380031e00, rc 0) 00000100:00100000:0.0:1788620214.547190:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+36:17517:x1875503657146880:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 190us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620214.547197:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 54 00000100:00100000:0.0:1788620214.550071:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.552835:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657147008 00000100:00100000:3.0:1788620214.552851:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657147008 00000100:00100000:3.0:1788620214.552923:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788620214.552949:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2355:x1875503657147008:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788620214.553307:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2355:x1875503657147008:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 360us (3244us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788620214.553315:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00080000:0.0:1788620214.553398:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788620214.560831:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.560863:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657147264 00000100:00100000:0.0:1788620214.560872:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657147264 00000100:00100000:0.0:1788620214.560924:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788620214.560933:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+36:17517:x1875503657147264:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788620214.561177:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+37:17517:x1875503657147264:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 244us (357us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788620214.561185:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 11 00000100:00100000:0.0:1788620214.569947:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.572117:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657147520 00000100:00100000:1.0:1788620214.572133:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657147520 00000100:00100000:1.0:1788620214.572223:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:1.0:1788620214.572238:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+37:17517:x1875503657147520:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788620214.572413:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+37:17517:x1875503657147520:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 178us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620214.572421:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 55 00000100:00100000:0.0:1788620214.579325:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.579426:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657147648 00000100:00100000:1.0:1788620214.579446:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657147648 00000100:00100000:1.0:1788620214.579512:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 56 00000100:00100000:1.0:1788620214.579522:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+37:17517:x1875503657147648:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788620214.579547:0:19017:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620214.579570:0:19017:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfeb9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06afb4 expref: -99 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.579640:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfec0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.579655:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfec0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.579667:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfec0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788620214.579705:0:19017:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788620214.579740:0:19017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfec0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.579767:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18f000/0xbb0e330328bbfeb9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afb4 expref: 39 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.579806:0:19017:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfec0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afb4 expref: 38 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.579814:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93338385a900) 00010000:00010000:1.0:1788620214.579817:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788620214.579820:0:19017:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18fa00, rc 0) 00000100:00100000:1.0:1788620214.580083:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+38:17517:x1875503657147648:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 561us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620214.580090:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 56 00000001:00080000:3.0:1788620214.581452:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901915 is committed 00000001:00080000:3.0:1788620214.581486:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901892 is committed 00000001:00080000:3.0:1788620214.581508:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:3.0:1788620214.581513:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901916 is committed 00000100:00100000:0.0:1788620214.585195:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.585356:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657147776 00000100:00100000:3.0:1788620214.585366:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657147776 00000100:00100000:3.0:1788620214.585455:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1788620214.585465:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333908a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2355:x1875503657147776:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788620214.585483:0:19705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788620214.585503:0:19705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06afbb expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788620214.585527:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c2db7, blocks: 0x1 00010000:00010000:3.0:1788620214.585548:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=617s v=(0 0) 00010000:00010000:3.0:1788620214.585553:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620214.585562:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afbb expref: 7 pid: 19705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.585591:0:19705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afbb expref: 7 pid: 19705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.585606:0:19705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333813cf600, rc 0) 00000100:00100000:3.0:1788620214.585682:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333908a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:2355:x1875503657147776:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 218us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620214.585689:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:2.0:1788620214.588831:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.589016:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657148032 00000100:00100000:1.0:1788620214.589026:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657148032 00000100:00100000:1.0:1788620214.589084:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788620214.589094:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+15:17517:x1875503657148032:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788620214.589210:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+15:17517:x1875503657148032:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 116us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620214.589218:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 57 00000100:00100000:1.0:1788620214.593845:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.593953:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657148160 00000100:00100000:0.0:1788620214.593962:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657148160 00000100:00100000:0.0:1788620214.594018:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:0.0:1788620214.594027:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+15:17517:x1875503657148160:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788620214.622748:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:3.0:1788620214.622785:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788620214.622980:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+13:17517:x1875503657148160:12345-192.168.203.12@tcp:44:lhsmtool_posix.0 Request processed in 28948us (29139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620214.622990:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 58 00000100:00100000:3.0:1788620214.624512:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620214.624539:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677053312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788620214.624621:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620214.624798:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677053312 00000100:00100000:2.0:1788620214.624806:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677053312 00000100:00100000:2.0:1788620214.624872:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788620214.624882:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875503677053312:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788620214.625052:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788620214.625192:0:19704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788620214.625195:0:19704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788620214.625262:0:19704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788620214.625264:0:19704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788620215 -> 1788620215 00002000:00010000:2.0:1788620214.625267:0:19704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788620214.625363:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875503677053312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 481us (740us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788620214.625370:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1788620214.625915:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9333bc476300/2, rc 0, transno 12884901891 00000100:00100000:3.0:1788620214.625924:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc476300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875503677053312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788620214.627742:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.627871:0:21145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657148288 00000100:00100000:3.0:1788620214.627879:0:21145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657148288 00000100:00100000:3.0:1788620214.627936:0:21145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788620214.627946:0:21145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:2355:x1875503657148288:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788620214.628240:0:21145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:2355:x1875503657148288:12345-192.168.203.12@tcp:16:lhsmtool_posix.0 Request processed in 294us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620214.628247:0:21145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788620214.630494:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.630601:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657148544 00000100:00100000:1.0:1788620214.630627:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657148544 00000100:00100000:1.0:1788620214.630743:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 59 00000100:00100000:1.0:1788620214.630753:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+13:17517:x1875503657148544:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788620214.630854:0:19016:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620214.630883:0:19016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfec0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afb4 expref: 13 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.630902:0:19016:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93338385a900) 00010000:00010000:1.0:1788620214.630908:0:19016:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788620214.630940:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.630953:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.630963:0:19016:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788620214.631209:0:19016:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b78f129 reply state 000000002c82f04a transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.631219:0:19016:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788620214.631313:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+14:17517:x1875503657148544:12345-192.168.203.12@tcp:36:lhsmtool_posix.0 Request processed in 560us (828us total) trans 12884901919 rc 0/0 00000100:00100000:1.0:1788620214.631319:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 59 00010000:00010000:3.0:1788620214.634918:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.634937:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.634944:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.634971:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e200 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:3.0:1788620214.634976:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.634985:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.635003:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93338385a900) 00010000:00010000:3.0:1788620214.635006:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788620214.635013:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.635019:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e200/0xbb0e330328bbfece lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19016 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620214.636719:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620214.637088:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657148672 00000100:00100000:2.0:1788620214.637099:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657148672 00000100:00100000:2.0:1788620214.637191:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788620214.637211:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:17517:x1875503657148672:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788620214.637229:0:19704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620214.637250:0:19704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06afc2 expref: -99 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.637284:0:19704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afbb expref: 8 pid: 19705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.637293:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620214.637297:0:19704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788620214.637303:0:19704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 8 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.637348:0:19704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afbb expref: 8 pid: 19705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.637387:0:19704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afbb expref: 8 pid: 19705 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620214.637402:0:19704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc475f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19704:1875503677053440:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788620214.637499:0:19704:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395cd2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788620214.641400:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620214.641481:0:21128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657148800 00000100:00100000:0.0:1788620214.641491:0:21128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657148800 00010000:00010000:0.0:1788620214.641535:0:21128:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afbb expref: 9 pid: 19705 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620214.641592:0:21128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:0.0:1788620214.641605:0:21128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:2355:x1875503657148800:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788620214.641620:0:21128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788620214.641645:0:21128:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afbb expref: 9 pid: 19705 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.641684:0:21128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afbb expref: 9 pid: 19705 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.641711:0:21128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620214.641937:0:21128:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788620214.641946:0:21128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 9 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.641957:0:21128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 9 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788620214.642062:0:21128:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 9 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620214.642076:0:21128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff93338703a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:21128:1875503677053568:192.168.203.12@tcp:105: 00000100:00100000:0.0:1788620214.642195:0:21128:0:(client.c:2716:ptlrpc_set_wait()) set ffff933392e61180 going to sleep for 11 seconds 00010000:00010000:2.0:1788620214.642392:0:19704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f050f37/0xbb0e330328bbfec7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afbb expref: 9 pid: 19705 timeout: 717 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620214.642408:0:19704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc475f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19704:1875503677053440:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788620214.642442:0:19704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 8 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.642454:0:19704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc143000, rc 0) 00000100:00100000:2.0:1788620214.642483:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+8:17517:x1875503657148672:12345-192.168.203.12@tcp:101:lhsmtool_posix.0 Request processed in 5275us (5773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.642492:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:0.0:1788620214.652096:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.652238:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657148928 00000100:00100000:3.0:1788620214.652249:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657148928 00000100:00100000:3.0:1788620214.652310:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:3.0:1788620214.652321:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+8:2354:x1875503657148928:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788620214.652557:0:19705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788620214.652561:0:19705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788620214 00002000:00010000:3.0:1788620214.652564:0:19705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788620212 00002000:00010000:3.0:1788620214.652566:0:19705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788620215 -> 1788620214 00002000:00010000:3.0:1788620214.652569:0:19705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788620214.652704:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933387039c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:2354:x1875503657148928:12345-192.168.203.12@tcp:2:lhsmtool_posix.0 Request processed in 384us (618us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788620214.652712:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788620214.674857:0:21128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff93338703a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:21128:1875503677053568:192.168.203.12@tcp:105: 00010000:00010000:2.0:1788620214.674887:0:21128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788620214.674984:0:21128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+8:2355:x1875503657148800:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 33381us (33594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.674995:0:21128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:2.0:1788620214.675855:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.676021:0:19703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657149056 00000100:00100000:3.0:1788620214.676030:0:19703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657149056 00000100:00100000:3.0:1788620214.676081:0:19703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:3.0:1788620214.676091:0:19703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+8:2357:x1875503657149056:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788620214.676139:0:19703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.676160:0:19703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 8 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.676169:0:19703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788620214.676174:0:19703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788620214.676179:0:19703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.676218:0:19703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 8 pid: 19704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.676238:0:19703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 8 pid: 19704 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788620214.676254:0:19703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19703:1875503677053696:192.168.203.12@tcp:104: 00000100:00100000:3.0:1788620214.676328:0:19703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9333a5053f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788620214.680487:0:19703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19703:1875503677053696:192.168.203.12@tcp:104: 00010000:00010000:3.0:1788620214.680521:0:19703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620214.687240:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.687453:0:19003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657149184 00000100:00100000:1.0:1788620214.687464:0:19003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657149184 00010000:00010000:1.0:1788620214.687509:0:19003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 9 pid: 19704 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.687570:0:19003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:1.0:1788620214.687581:0:19003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+9:2354:x1875503657149184:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620214.687595:0:19003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620214.687617:0:19003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 9 pid: 19704 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.687636:0:19003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 9 pid: 19704 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.687667:0:19003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000062c1e70/0xbb0e330328bbfed5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc2 expref: 9 pid: 19704 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.687684:0:19003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620214.687689:0:19003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788620214.687696:0:19003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.687706:0:19003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.687921:0:19003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620214.687971:0:19003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc475c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+8:2354:x1875503657149184:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 392us (740us total) trans 0 rc 0/0 00010000:00010000:2.0:1788620214.687976:0:19703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.687981:0:19003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00010000:00010000:2.0:1788620214.687990:0:19703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.688024:0:19703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.688034:0:19703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.688042:0:19703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.688049:0:19703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333813cf800 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:2.0:1788620214.688054:0:19703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.688063:0:19703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.688076:0:19703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.688084:0:19703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec4d14d/0xbb0e330328bbfedc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620214.688142:0:19703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc475f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:2357:x1875503657149056:12345-192.168.203.12@tcp:1:lhsmtool_posix.0 Request processed in 12052us (12291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.688150:0:19703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:0.0:1788620214.691905:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620214.692073:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657149440 00000100:00100000:2.0:1788620214.692083:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657149440 00000100:00100000:2.0:1788620214.692147:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 60 00000100:00100000:2.0:1788620214.692157:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+13:17517:x1875503657149440:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788620214.693023:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.693042:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.693053:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.693328:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.693344:0:19018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afad expref: 14 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.693351:0:19018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.693384:0:19018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afad expref: 14 pid: 19017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.693413:0:19018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afad expref: 14 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620214.693427:0:19018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc475500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19018:1875503677053824:192.168.203.12@tcp:104: 00000100:00100000:2.0:1788620214.693544:0:19018:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395cd2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788620214.697945:0:19018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc475500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19018:1875503677053824:192.168.203.12@tcp:104: 00010000:00010000:2.0:1788620214.697980:0:19018:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788620214.698878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.699120:0:19001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657149568 00000100:00100000:1.0:1788620214.699129:0:19001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657149568 00010000:00010000:1.0:1788620214.699178:0:19001:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afad expref: 15 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.699224:0:19001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:1.0:1788620214.699235:0:19001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9332848e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+15:2354:x1875503657149568:12345-192.168.203.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788620214.699250:0:19001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788620214.699256:0:19001:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afad expref: 15 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.699273:0:19001:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afad expref: 15 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.699295:0:19001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff933380031e00/0xbb0e330328bbfeb2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afad expref: 15 pid: 19017 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.699317:0:19001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93338385a900) 00010000:00010000:1.0:1788620214.699323:0:19001:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.699332:0:19001:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.699339:0:19001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.699367:0:19001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788620214.699418:0:19001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9332848e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+14:2354:x1875503657149568:12345-192.168.203.12@tcp:103:ldlm_bl.0 Request processed in 184us (544us total) trans 0 rc 0/0 00010000:00010000:2.0:1788620214.699425:0:19018:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.699449:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.699455:0:19001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000001:00080000:2.0:1788620214.699652:0:19018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1788620214.699927:0:19018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1788620214.699977:0:19018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1788620214.700059:0:19018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc475500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:19018:1875503677053952:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788620214.700106:0:19018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620214.700136:0:19018:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395cd2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788620214.704349:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677053952 00000100:00100000:3.0:1788620214.704364:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677053952 00000100:00100000:3.0:1788620214.704448:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788620214.704459:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19018:x1875503677053952:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788620214.704459:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788620214.704468:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788620214.704603:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc476d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19018:x1875503677053952:12345-0@lo:1000:mdt00_002.0 Request processed in 145us (4496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620214.704611:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788620214.704821:0:19018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc475500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:19018:1875503677053952:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788620214.705535:0:19018:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1788620214.705623:0:19018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc475500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:19018:1875503677054080:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788620214.705690:0:19018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620214.705721:0:19018:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395cd2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788620214.705760:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677054080 00000100:00100000:3.0:1788620214.705766:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677054080 00000100:00100000:3.0:1788620214.705824:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788620214.705832:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19018:x1875503677054080:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788620214.706012:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:19018:x1875503677054080:12345-0@lo:1000:mdt00_002.0 Request processed in 180us (321us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788620214.706019:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788620214.707045:0:19018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc475500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:19018:1875503677054080:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788620214.707089:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707099:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707106:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707112:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142c00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620214.707116:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707124:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707140:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93338385a900) 00010000:00010000:2.0:1788620214.707143:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788620214.707148:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707155:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbfeea lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707241:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707249:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707914:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707921:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc7c2800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:2.0:1788620214.707924:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707931:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707941:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385af00) 00010000:00010000:2.0:1788620214.707944:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788620214.707951:0:19018:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfe49 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af91 expref: 17 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707962:0:19018:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfe49 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af91 expref: 17 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.707971:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfe49 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af91 expref: 17 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.708009:0:19018:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c3e00/0xbb0e330328bbfe49 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06af91 expref: 17 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788620214.708023:0:19018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc474000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19018:1875503677054208:192.168.203.12@tcp:105: 00000100:00100000:2.0:1788620214.708111:0:19018:0:(client.c:2716:ptlrpc_set_wait()) set ffff933395cd2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788620214.720056:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.720224:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657149696 00000100:00100000:3.0:1788620214.720233:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657149696 00000100:00100000:3.0:1788620214.720294:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:3.0:1788620214.720304:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+18:17516:x1875503657149696:12345-192.168.203.12@tcp:49:bash.0 00000100:00100000:3.0:1788620214.720421:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+18:17516:x1875503657149696:12345-192.168.203.12@tcp:49:bash.0 Request processed in 118us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620214.720427:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 12 00000100:00100000:1.0:1788620214.720581:0:19018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc474000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19018:1875503677054208:192.168.203.12@tcp:105: 00010000:00010000:1.0:1788620214.720617:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720627:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc7c2800/0xbb0e330328bbfe42 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720657:0:19018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720672:0:19018:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720682:0:19018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720693:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720699:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720707:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720712:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18fa00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620214.720716:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720722:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720761:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385af00) 00010000:00010000:1.0:1788620214.720765:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620214.720784:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720792:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbfef1 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720803:0:19018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720810:0:19018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720817:0:19018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720823:0:19018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc142800 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620214.720826:0:19018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720832:0:19018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720840:0:19018:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385af00) 00010000:00010000:1.0:1788620214.720843:0:19018:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788620214.720846:0:19018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.720852:0:19018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142800/0xbb0e330328bbfee3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19018 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.721072:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93338703a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+17:17517:x1875503657149440:12345-192.168.203.12@tcp:57:lhsmtool_posix.0 Request processed in 28914us (29174us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1788620214.721081:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 60 00000020:00080000:1.0:1788620214.721085:0:19018:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788620214.721324:0:19048:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788620214.721329:0:19048:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788620214.721355:0:19048:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788620214.721360:0:19048:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788620214.725605:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.725741:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657149952 00000100:00100000:3.0:1788620214.725752:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657149952 00000100:00100000:0.0:1788620214.725972:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.726037:0:19705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657150080 00000100:00100000:1.0:1788620214.726041:0:19705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657150080 00000100:00100000:1.0:1788620214.726092:0:19705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:1.0:1788620214.726102:0:19705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+7:17516:x1875503657150080:12345-192.168.203.12@tcp:101:bash.0 00010000:00010000:1.0:1788620214.726119:0:19705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788620214.726139:0:19705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045b05d39/0xbb0e330328bbfef8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06afc9 expref: -99 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788620214.726174:0:19705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a9c2db6, atime: 0x6a9c2db4, ctime: 0x6a9c2db6, blocks: 0x1 00010000:00010000:1.0:1788620214.726199:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=617s v=(0 0) 00010000:00010000:1.0:1788620214.726204:0:19705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788620214.726215:0:19705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045b05d39/0xbb0e330328bbfef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc9 expref: 8 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.726230:0:19705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045b05d39/0xbb0e330328bbfef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afc9 expref: 8 pid: 19705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.726242:0:19705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc18fc00, rc 0) 00000100:00100000:1.0:1788620214.726297:0:19705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:650abbe2-2298-4f6c-8c17-cc86374bb18c+8:17516:x1875503657150080:12345-192.168.203.12@tcp:101:bash.0 Request processed in 196us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620214.726303:0:19705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:3.0:1788620214.726699:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 13 00000100:00100000:3.0:1788620214.726709:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+17:17517:x1875503657149952:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788620214.727720:0:19019:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788620214.729612:0:19019:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1788620214.729682:0:19019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.729707:0:19019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.729720:0:19019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.729729:0:19019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.729735:0:19019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.729741:0:19019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.729763:0:19019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788620214.729924:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+19:17517:x1875503657149952:12345-192.168.203.12@tcp:35:lhsmtool_posix.0 Request processed in 3212us (4324us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1788620214.729934:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 13 00000020:00080000:2.0:1788620214.729940:0:19019:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788620214.730544:0:19005:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788620214.730553:0:19005:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.730561:0:19005:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc143000 already unused, calling callback (ffffffffc148e4f0) 00010000:00010000:3.0:1788620214.730565:0:19005:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.730572:0:19005:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.730585:0:19005:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff93338385a900) 00010000:00010000:3.0:1788620214.730587:0:19005:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788620214.730591:0:19005:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.730597:0:19005:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc143000/0xbb0e330328bbfeff lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19019 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788620214.730610:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620214.730612:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788620214.730613:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620214.731724:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.731826:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657150336 00000100:00100000:3.0:1788620214.731837:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657150336 00000100:00100000:3.0:1788620214.731888:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 14 00000100:00100000:3.0:1788620214.731899:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+19:17516:x1875503657150336:12345-192.168.203.12@tcp:35:bash.0 00000001:00080000:3.0:1788620214.732406:0:19020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:3.0:1788620214.732526:0:19020:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:3.0:1788620214.732651:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+22:17516:x1875503657150336:12345-192.168.203.12@tcp:35:bash.0 Request processed in 753us (933us total) trans 12884901929 rc 0/0 00000100:00100000:3.0:1788620214.732660:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 14 00000020:00080000:3.0:1788620214.732666:0:19020:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788620214.875391:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620214.875521:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657150592 00000100:00100000:2.0:1788620214.875532:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657150592 00000100:00100000:2.0:1788620214.875598:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:2.0:1788620214.875610:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+22:17528:x1875503657150592:12345-192.168.203.12@tcp:101:lfs.0 00010000:00010000:2.0:1788620214.875634:0:20890:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788620214.875653:0:20890:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbff06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba28e806b06afd0 expref: -99 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788620214.876041:0:20890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788620214.876183:0:20890:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbff06 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afd0 expref: 24 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.876199:0:20890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93338385ae00) 00010000:00010000:2.0:1788620214.876203:0:20890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788620214.876209:0:20890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc142c00/0xbb0e330328bbff06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.12@tcp remote: 0xfba28e806b06afd0 expref: 24 pid: 20890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788620214.876224:0:20890:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9333bc142c00, rc 0) 00000100:00100000:2.0:1788620214.876337:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+23:17528:x1875503657150592:12345-192.168.203.12@tcp:101:lfs.0 Request processed in 729us (957us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1788620214.876344:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 61 00000100:00100000:0.0:1788620214.889521:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:1.0:1788620214.890137:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657150720 00000100:00100000:1.0:1788620214.890149:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657150720 00000100:00100000:1.0:1788620214.890306:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:1.0:1788620214.890318:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+23:17528:x1875503657150720:12345-192.168.203.12@tcp:34:lfs.0 00010000:00010000:1.0:1788620214.890396:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890413:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890426:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890454:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890462:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890469:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890715:0:19017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890724:0:19017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890731:0:19017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788620214.890808:0:19017:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890828:0:19017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890835:0:19017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890841:0:19017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890847:0:19017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18fa00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620214.890851:0:19017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890859:0:19017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890872:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff93338385a100) 00010000:00010000:1.0:1788620214.890875:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620214.890879:0:19017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890885:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18fa00/0xbb0e330328bbff14 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890896:0:19017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890902:0:19017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890907:0:19017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890918:0:19017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18ea00 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620214.890921:0:19017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890926:0:19017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890934:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff93338604a400) 00010000:00010000:1.0:1788620214.890936:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620214.890939:0:19017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890944:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18ea00/0xbb0e330328bbff1b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890959:0:19017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890965:0:19017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890971:0:19017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890975:0:19017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9333bc18e000 already unused, calling callback (ffffffffc1ed24f0) 00010000:00010000:1.0:1788620214.890978:0:19017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.890983:0:19017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.891000:0:19017:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff93338385af00) 00010000:00010000:1.0:1788620214.891002:0:19017:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788620214.891006:0:19017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788620214.891011:0:19017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9333bc18e000/0xbb0e330328bbff22 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788620214.891101:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+23:17528:x1875503657150720:12345-192.168.203.12@tcp:34:lfs.0 Request processed in 784us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620214.891109:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 62 00000100:00100000:0.0:1788620214.895089:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620214.895143:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657150976 00000100:00100000:3.0:1788620214.895153:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657150976 00000100:00100000:3.0:1788620214.895211:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788620214.895221:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+23:17528:x1875503657150976:12345-192.168.203.12@tcp:35:lfs.0 00000100:00100000:3.0:1788620214.895595:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:650abbe2-2298-4f6c-8c17-cc86374bb18c+24:17528:x1875503657150976:12345-192.168.203.12@tcp:35:lfs.0 Request processed in 374us (513us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1788620214.895604:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 15 00000100:00100000:3.0:1788620214.983042:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677054720:0@lo:400:kworker.0 00000100:00100000:3.0:1788620214.983115:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788620214.983199:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788620214.983208:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677054848:0@lo:400:kworker.0 00000100:00100000:3.0:1788620214.983233:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620214.983419:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677054336:0@lo:400:kworker.0 00000100:00100000:1.0:1788620214.983466:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788620214.983490:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677054720 00000100:00100000:1.0:1788620214.983495:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677054976:0@lo:400:kworker.0 00000100:00100000:0.0:1788620214.983500:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677054720 00000100:00100000:1.0:1788620214.983520:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620214.983538:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788620214.983543:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677054592:0@lo:400:kworker.0 00000100:00100000:0.0:1788620214.983551:0:19016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677054848 00000100:00100000:0.0:1788620214.983556:0:19016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677054848 00000100:00100000:1.0:1788620214.983569:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620214.983597:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677054464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788620214.983620:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788620214.983648:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677054976 00000100:00100000:1.0:1788620214.983652:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677054976 00000100:00100000:1.0:1788620214.983677:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788620214.983685:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677054720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788620214.983718:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788620214.983729:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677054976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788620214.983742:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875503677054720:12345-0@lo:400:kworker.0 Request processed in 55us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788620214.983800:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875503677054976:12345-0@lo:400:kworker.0 Request processed in 73us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788620214.983810:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788620214.983881:0:19706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677054464 00000100:00100000:2.0:1788620214.983885:0:19706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677054464 00000100:00100000:2.0:1788620214.983919:0:19706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788620214.983927:0:19706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677054464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788620214.983957:0:19706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788620214.984004:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788620214.984009:0:19706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677054464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.984017:0:19706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788620214.984028:0:19016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788620214.984039:0:19016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677054848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788620214.984049:0:19704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677054592 00000100:00100000:2.0:1788620214.984053:0:19704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677054592 00000100:00100000:0.0:1788620214.984078:0:19016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875503677054848:12345-0@lo:400:kworker.0 Request processed in 42us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.984085:0:19704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788620214.984089:0:19016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788620214.984098:0:19704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677054592:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788620214.984112:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788620214.984118:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788620214.984134:0:19704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875503677054592:12345-0@lo:400:kworker.0 Request processed in 39us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620214.984141:0:19704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788620214.984152:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677054592:0@lo:400:kworker.0 00000100:00100000:0.0:1788620214.984172:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff933285998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875503677054464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788620214.984198:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc121880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875503677054976:0@lo:400:kworker.0 00000100:00100000:2.0:1788620214.984218:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc123800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875503677054848:0@lo:400:kworker.0 00000100:00100000:2.0:1788620214.984230:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc122680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875503677054720:0@lo:400:kworker.0 00000100:00100000:3.0:1788620214.985681:0:19009:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677054336 00000100:00100000:3.0:1788620214.985692:0:19009:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677054336 00000100:00100000:3.0:1788620214.988523:0:19009:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788620214.988558:0:19009:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:3309:x1875503677054336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788620214.988661:0:19009:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b50befa-471f-4f69-9917-f69b46ba475e+19:3309:x1875503677054336:12345-0@lo:400:kworker.0 Request processed in 124us (5194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620214.988669:0:19009:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788620214.988817:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b50befa-471f-4f69-9917-f69b46ba475e:3309:1875503677054336:0@lo:400:kworker.0 00010000:00010000:1.0:1788620215.110972:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788620216.008064:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788620216.008092:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9333bc477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677055104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788620216.008172:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788620216.008341:0:19706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503677055104 00000100:00100000:2.0:1788620216.008351:0:19706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503677055104 00000100:00100000:2.0:1788620216.008416:0:19706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788620216.008436:0:19706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503677055104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788620216.008471:0:19706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788620216.008513:0:19706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333c1ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875503677055104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620216.008520:0:19706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788620216.008604:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9333bc477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875503677055104:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788620216.008662:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788620216.060677:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000001:00080000:2.0:1788620216.060892:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00000001:00080000:2.0:1788620216.060896:0:6720:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901892 is committed 00010000:00010000:3.0:1788620216.135199:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788620216.745342:0:21184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788620217.158941:0:19004:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788620217.251892:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620217.251938:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620217.251975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620217.252010:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620217.252042:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620217.252056:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:0.0:1788620217.252075:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:2.0:1788620217.252151:0:21145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657151488 00000100:00100000:2.0:1788620217.252160:0:21145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657151488 00000100:00100000:2.0:1788620217.252211:0:21145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657151744 00000100:00100000:2.0:1788620217.252214:0:21145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657151744 00000100:00100000:2.0:1788620217.252225:0:21145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657151360 00000100:00100000:2.0:1788620217.252227:0:21145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657151360 00000100:00100000:2.0:1788620217.252235:0:21145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657151872 00000100:00100000:2.0:1788620217.252238:0:21145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657151872 00000100:00100000:2.0:1788620217.252252:0:21145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788620217.252260:0:21145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2355:x1875503657151488:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620217.252331:0:21145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+5:2355:x1875503657151488:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 71us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620217.252339:0:21145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 16 00000100:00100000:2.0:1788620217.252355:0:21145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788620217.252370:0:21145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2355:x1875503657151744:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620217.252397:0:21145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2355:x1875503657151744:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620217.252403:0:21145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 17 00000100:00100000:2.0:1788620217.252425:0:21145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788620217.252432:0:21145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93328599a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2355:x1875503657151360:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620217.252456:0:21145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93328599a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2355:x1875503657151360:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620217.252462:0:21145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 18 00000100:00100000:2.0:1788620217.252472:0:21145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788620217.252478:0:21145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2355:x1875503657151872:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620217.252498:0:21145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+5:2355:x1875503657151872:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 21us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620217.252504:0:21145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 19 00000100:00100000:2.0:1788620217.252522:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657151232 00000100:00100000:2.0:1788620217.252525:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657151232 00000100:00100000:2.0:1788620217.252550:0:20890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657151616 00000100:00100000:2.0:1788620217.252553:0:20890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657151616 00000100:00100000:2.0:1788620217.252571:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1788620217.252578:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+24:2355:x1875503657151232:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620217.252609:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+24:2355:x1875503657151232:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 32us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620217.252615:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 26 00000100:00100000:2.0:1788620217.252625:0:20890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:2.0:1788620217.252637:0:20890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff933285998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:2355:x1875503657151616:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:2.0:1788620217.252662:0:20890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff933285998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e7c429e-d062-4f14-bf7d-b01316b70d9e+6:2355:x1875503657151616:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 26us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788620217.252668:0:20890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 27 00000100:00100000:3.0:1788620217.252885:0:19010:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657151104 00000100:00100000:3.0:1788620217.252889:0:19010:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657151104 00000100:00100000:3.0:1788620217.252926:0:19010:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00100000:3.0:1788620217.252934:0:19010:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bb93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:2355:x1875503657151104:12345-192.168.203.12@tcp:400:kworker.0 00000100:00100000:3.0:1788620217.252965:0:19010:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bb93d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d60730b-28cb-42c6-8d16-5b7e5fbfd7e8+13:2355:x1875503657151104:12345-192.168.203.12@tcp:400:kworker.0 Request processed in 33us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620217.252972:0:19010:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 121 00000100:00080000:0.0:1788620217.253580:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788620217.253585:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788620217.253588:0:19011:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788620218.183386:0:19005:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788620218.281183:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620218.281229:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.12@tcp (source: 12345-192.168.203.12@tcp) 00000100:00100000:3.0:1788620218.281263:0:21145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657152128 00000100:00100000:3.0:1788620218.281273:0:21145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657152128 00000100:00100000:3.0:1788620218.281330:0:21145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:3.0:1788620218.281342:0:21145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2356:x1875503657152128:12345-192.168.203.12@tcp:16:kworker.0 00000100:00100000:3.0:1788620218.281481:0:21145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2356:x1875503657152128:12345-192.168.203.12@tcp:16:kworker.0 Request processed in 142us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788620218.281490:0:21145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 20 00000100:00100000:1.0:1788620218.282030:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875503657152000 00000100:00100000:1.0:1788620218.282037:0:19708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875503657152000 00002000:00100000:1.0:1788620218.282071:0:19708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff9333bc121f80 x1875503657152000/t0(0) o4->650abbe2-2298-4f6c-8c17-cc86374bb18c@192.168.203.12@tcp:314/0 lens 504/0 e 0 to 0 dl 1788620229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788620218.282083:0:19708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bc121f80 with x1875503657152000 ext(0->8) 00002000:00010000:1.0:1788620218.282088:0:19708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9333bc121f80 00000100:00100000:1.0:1788620218.282115:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.12@tcp, seq: 0 00000100:00100000:1.0:1788620218.282124:0:19708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9333bc121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+6:2356:x1875503657152000:12345-192.168.203.12@tcp:4:bash.0 00000100:00100000:1.0:1788620218.282667:0:19708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9333bc121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:650abbe2-2298-4f6c-8c17-cc86374bb18c+8:2356:x1875503657152000:12345-192.168.203.12@tcp:4:bash.0 Request processed in 541us (1492us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788620218.282675:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.12@tcp, seq: 0 00002000:00100000:1.0:1788620218.282683:0:19708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->8) req@ffff9333bc121f80 x1875503657152000/t12884901894(0) o4->650abbe2-2298-4f6c-8c17-cc86374bb18c@192.168.203.12@tcp:314/0 lens 504/448 e 0 to 0 dl 1788620229 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788620218.282691:0:19708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9333bc121f80 with x1875503657152000 ext(0->8) 00002000:00010000:1.0:1788620218.282701:0:19708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9333bc121f80 Debug log: 9784 lines, 9784 kept, 0 dropped, 0 bad.