00010000:00010000:0.0F:1789127105.582616:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1789127105.706822:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127105.706860:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276852480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127105.707073:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1789127105.710784:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276852480 00000100:00100000:3.0:1789127105.710826:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276852480 00000100:00100000:3.0:1789127105.710953:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789127105.710964:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276852480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127105.711002:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789127105.711097:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276852480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127105.711105:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789127105.711178:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276852480:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1789127105.714638:0:17857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1789127105.714680:0:17857:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff994234620cc0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1789127105.714686:0:17857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9941049e1600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994234620240 00000020:00080000:3.0:1789127105.714690:0:17857:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9941049e1c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994102c56200 00000020:00080000:1.0:1789127105.714756:0:17918:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1789127105.714836:0:17918:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789127105.714912:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127105.714926:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127105.715023:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127105.715030:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbc00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127105.715035:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127105.715043:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127105.715061:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:0.0:1789127105.715064:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127105.715069:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127105.715076:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbc00/0xa840b4da666ec30d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17877 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127106.226254:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127106.226281:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994103076940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276852608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127106.226353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127106.226434:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276852608 00000100:00100000:3.0:1789127106.226441:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276852608 00000100:00100000:3.0:1789127106.226483:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789127106.226491:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276852608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127106.226524:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127106.226564:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276852608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127106.226571:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789127106.226710:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994103076940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276852608:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789127106.608596:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1789127106.730925:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276852736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127106.731018:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127106.733224:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276852736 00000100:00100000:3.0:1789127106.733248:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276852736 00000100:00100000:3.0:1789127106.733495:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127106.733522:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276852736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127106.733573:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789127106.733697:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276852736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 193us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127106.733706:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127106.733787:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941030770c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276852736:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789127106.739454:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789127106.861124:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789127107.548617:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127107.548686:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258955264 00000100:00100000:2.0:1789127107.548697:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258955264 00000100:00100000:2.0:1789127107.548775:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00100000:2.0:1789127107.548787:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+13:15838:x1876035258955264:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789127107.548936:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103074b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+13:15838:x1876035258955264:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127107.548945:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 65 00000100:00080000:2.0:1789127107.548969:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127107.575560:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127107.575770:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258955392 00000100:00100000:0.0:1789127107.575782:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258955392 00000100:00100000:0.0:1789127107.575993:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00100000:0.0:1789127107.576007:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+5:15838:x1876035258955392:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789127107.576152:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:51fd9021-bb15-44c1-9135-323c18d5cef9+5:15838:x1876035258955392:12345-192.168.203.23@tcp:60:lhsmtool_posix.0 Request processed in 149us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127107.576171:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 66 00000100:00080000:3.0:1789127107.576468:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127107.586622:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127107.586695:0:17880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258955648 00000100:00100000:3.0:1789127107.586705:0:17880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258955648 00000100:00100000:3.0:1789127107.586766:0:17880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:3.0:1789127107.586777:0:17880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+13:15838:x1876035258955648:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789127107.587400:0:17880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+14:15838:x1876035258955648:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 622us (794us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1789127107.587409:0:17880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00010000:00010000:1.0:1789127107.630432:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127107.755216:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127107.755245:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276852992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127107.755332:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127107.755417:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276852992 00000100:00100000:1.0:1789127107.755425:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276852992 00000100:00100000:1.0:1789127107.755478:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127107.755488:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276852992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127107.755513:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789127107.755555:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276852992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127107.755562:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127107.755622:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276852992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127107.755888:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127107.755901:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276852864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127107.755950:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127107.756214:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127107.756224:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276853120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127107.756259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127107.756289:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127107.756301:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276852864 00000100:00100000:3.0:1789127107.756305:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276852864 00000100:00100000:3.0:1789127107.756331:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276853120 00000100:00100000:3.0:1789127107.756333:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276853120 00000100:00100000:3.0:1789127107.756347:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127107.756353:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276852864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127107.756392:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127107.756427:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276852864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127107.756434:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127107.756447:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127107.756453:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276853120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127107.756461:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127107.756484:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276853120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127107.756490:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789127107.756506:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127107.756527:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276853120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127107.756553:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276852864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127107.756930:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276853504:0@lo:400:kworker.0 00000100:00100000:1.0:1789127107.757217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127107.757243:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276854016:0@lo:400:kworker.0 00000100:00100000:1.0:1789127107.757266:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127107.757284:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789127107.757290:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276853632:0@lo:400:kworker.0 00000100:00100000:1.0:1789127107.757317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127107.757336:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276854144:0@lo:400:kworker.0 00000100:00100000:1.0:1789127107.757366:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127107.757408:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276853504 00000100:00100000:1.0:1789127107.757413:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276853504 00000100:00100000:1.0:1789127107.757450:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276854016 00000100:00100000:1.0:1789127107.757454:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276854016 00000100:00100000:1.0:1789127107.757486:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276854144 00000100:00100000:1.0:1789127107.757489:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276854144 00000100:00100000:1.0:1789127107.757504:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789127107.757510:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276853504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127107.757557:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276853504:12345-0@lo:400:kworker.0 Request processed in 46us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127107.757564:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789127107.757579:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789127107.757585:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276854016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127107.757613:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276854016:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127107.757620:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789127107.757631:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789127107.757638:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276854144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127107.757700:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276854144:12345-0@lo:400:kworker.0 Request processed in 62us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127107.757707:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789127107.757728:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276853632 00000100:00100000:1.0:1789127107.757732:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276853632 00000100:00100000:1.0:1789127107.757757:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789127107.757764:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276853632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127107.757811:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276853632:12345-0@lo:400:kworker.0 Request processed in 48us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127107.757828:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127107.758178:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276853376:0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758219:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127107.758264:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276853888:0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758288:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127107.758305:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276854400:0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758323:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127107.758341:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789127107.758346:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276853248:0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127107.758392:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276853760:0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127107.758432:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276854272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127107.758473:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276853248 00000100:00100000:2.0:1789127107.758484:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276853248 00000100:00100000:2.0:1789127107.758513:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789127107.758519:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276853248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758552:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276853248:12345-0@lo:400:kworker.0 Request processed in 33us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127107.758559:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789127107.758585:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276853760 00000100:00100000:2.0:1789127107.758588:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276853760 00000100:00100000:2.0:1789127107.758610:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127107.758617:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276853760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758683:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276853760:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127107.758690:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127107.758707:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276853888 00000100:00100000:2.0:1789127107.758711:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276853888 00000100:00100000:2.0:1789127107.758728:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276854400 00000100:00100000:2.0:1789127107.758730:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276854400 00000100:00100000:2.0:1789127107.758745:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276854272 00000100:00100000:2.0:1789127107.758747:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276854272 00000100:00100000:2.0:1789127107.758761:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789127107.758768:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103076940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276853888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758809:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103076940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276853888:12345-0@lo:400:kworker.0 Request processed in 42us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127107.758815:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789127107.758827:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789127107.758833:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994103077840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276854400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.758875:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994103077840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276854400:12345-0@lo:400:kworker.0 Request processed in 42us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127107.758888:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789127107.758900:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789127107.758906:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276854272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127107.759102:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276853376 00000100:00100000:3.0:1789127107.759107:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276853376 00000100:00100000:3.0:1789127107.759131:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127107.759137:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276853376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127107.759175:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941030770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276853376:12345-0@lo:400:kworker.0 Request processed in 38us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127107.759181:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127107.759263:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276853248:0@lo:400:kworker.0 00000100:00100000:3.0:1789127107.759277:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276853760:0@lo:400:kworker.0 00000100:00100000:3.0:1789127107.759288:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276853376:0@lo:400:kworker.0 00000100:00100000:3.0:1789127107.759297:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276853888:0@lo:400:kworker.0 00010000:00080000:3.0:1789127107.759317:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99420a88cb40 x1876035276854400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127107.759328:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276854400:0@lo:400:kworker.0 00000100:00080000:0.0:1789127107.760259:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127107.760270:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127107.760333:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276853632:0@lo:400:kworker.0 00010000:00080000:0.0:1789127107.760353:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941043d83c0 x1876035276854144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127107.760363:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043d83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276854144:0@lo:400:kworker.0 00000100:00100000:0.0:1789127107.760376:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276853504:0@lo:400:kworker.0 00000100:00100000:0.0:1789127107.760388:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276854016:0@lo:400:kworker.0 00000100:00100000:2.0:1789127107.766252:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276854272:12345-0@lo:400:kworker.0 Request processed in 7326us (7780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127107.766271:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789127107.769146:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410406bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276854272:0@lo:400:kworker.0 00000100:00100000:3.0:1789127107.925962:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127107.926022:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127107.926215:0:17870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258955776 00000100:00100000:2.0:1789127107.926227:0:17870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258955776 00000100:00100000:2.0:1789127107.926300:0:17870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:2.0:1789127107.926311:0:17870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2391:x1876035258955776:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127107.926416:0:17870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2391:x1876035258955776:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 107us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127107.926425:0:17870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 171 00000100:00100000:3.0:1789127107.927271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127107.927538:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258955904 00000100:00100000:0.0:1789127107.927555:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258955904 00000100:00100000:0.0:1789127107.927630:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258956032 00000100:00100000:0.0:1789127107.927634:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258956032 00000100:00100000:0.0:1789127107.927705:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:0.0:1789127107.927715:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2391:x1876035258955904:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127107.927773:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fb8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2391:x1876035258955904:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 60us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127107.927781:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:0.0:1789127107.927809:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1789127107.927817:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410406bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2390:x1876035258956032:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:0.0:1789127107.927857:0:19386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ec043 00000100:00080000:0.0:1789127107.927876:0:19386:0:(import.c:65:import_set_state_nolock()) ffff9941030cd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789127107.928186:0:19386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:1.0:1789127107.928319:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127107.928700:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127107.928706:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127107.929499:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410406bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+2:2390:x1876035258956032:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 1672us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127107.929514:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:3.0:1789127107.933476:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127107.933526:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127107.933705:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127107.933735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127107.934804:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258956416 00000100:00100000:0.0:1789127107.934819:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258956416 00000100:00100000:0.0:1789127107.934894:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258956544 00000100:00100000:0.0:1789127107.934898:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258956544 00000100:00100000:0.0:1789127107.934934:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:0.0:1789127107.934945:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2390:x1876035258956416:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:0.0:1789127107.934982:0:20286:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ec082 00000100:00080000:0.0:1789127107.935002:0:20286:0:(import.c:65:import_set_state_nolock()) ffff994102f32000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789127107.935058:0:20286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1789127107.935261:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+2:2390:x1876035258956416:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 316us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127107.935270:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:0.0:1789127107.935286:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1789127107.935293:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2390:x1876035258956544:12345-192.168.203.23@tcp:9:kworker.0 00000020:00000080:0.0:1789127107.935309:0:20286:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ec07b 00000100:00080000:0.0:1789127107.935315:0:20286:0:(import.c:65:import_set_state_nolock()) ffff994220b34800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789127107.935342:0:20286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789127107.935409:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+2:2390:x1876035258956544:12345-192.168.203.23@tcp:9:kworker.0 Request processed in 116us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127107.935416:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00010000:00010000:0.0:1789127107.935532:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127107.936024:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127107.936036:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127107.936041:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127107.937681:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258956160 00000100:00100000:2.0:1789127107.937694:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258956160 00000100:00100000:2.0:1789127107.937824:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258956288 00000100:00100000:2.0:1789127107.937829:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258956288 00000100:00100000:2.0:1789127107.937865:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1789127107.937876:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2391:x1876035258956160:12345-192.168.203.23@tcp:400:kworker.0 00000100:00080000:3.0:1789127107.937912:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127107.937917:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127107.937987:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2391:x1876035258956160:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 113us (4527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127107.937996:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 78 00000100:00100000:2.0:1789127107.938013:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 79 00000100:00100000:2.0:1789127107.938020:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2392:x1876035258956288:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127107.938047:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2392:x1876035258956288:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127107.938070:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 79 00010000:00010000:1.0:1789127108.651255:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127109.674811:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127110.698913:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127110.826967:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276854528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127110.827069:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127110.827270:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276854528 00000100:00100000:3.0:1789127110.827279:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276854528 00000100:00100000:3.0:1789127110.827348:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127110.827358:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276854528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127110.827398:0:17882:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789127110.827587:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276854528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 230us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127110.827596:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789127110.827713:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276854528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127111.338955:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276854656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127111.339065:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127111.339143:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276854656 00000100:00100000:1.0:1789127111.339153:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276854656 00000100:00100000:1.0:1789127111.339218:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789127111.339229:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276854656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127111.339276:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127111.339344:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276854656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127111.339353:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789127111.339627:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276854656:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789127111.726835:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127111.851322:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276854784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127111.851403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127111.851619:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276854784 00000100:00100000:1.0:1789127111.851630:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276854784 00000100:00100000:1.0:1789127111.851736:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789127111.851748:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276854784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127111.851798:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789127111.851880:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276854784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127111.852057:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789127111.852511:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127111.852556:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276854784:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1789127111.853063:0:17857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1789127111.853070:0:17857:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1789127111.853222:0:17918:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1789127111.853232:0:17918:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:02000400:0.0:1789127112.306117:0:21264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 07:45:10 (1789127110) 00000040:00080000:1.0:1789127112.363966:0:17910:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789127112.363975:0:17910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127112.364007:0:17910:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789127112.364014:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789127112.746807:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127112.875064:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127112.875087:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276855040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127112.875158:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127112.875221:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276855040 00000100:00100000:0.0:1789127112.875229:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276855040 00000100:00100000:0.0:1789127112.875284:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127112.875295:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276855040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127112.875324:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789127112.875371:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276855040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127112.875380:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789127112.875402:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127112.875436:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276855040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127112.875554:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276854912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127112.875586:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.875902:0:20797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276854912 00000100:00100000:3.0:1789127112.875907:0:20797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276854912 00000100:00100000:3.0:1789127112.875945:0:20797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127112.875952:0:20797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276854912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127112.875964:0:20797:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127112.876001:0:20797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276854912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.876008:0:20797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127112.876039:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276854912:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789127112.876141:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127112.877344:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127112.877361:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276855168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127112.877416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127112.877455:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276855168 00000100:00100000:0.0:1789127112.877460:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276855168 00000100:00100000:0.0:1789127112.877503:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127112.877520:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276855168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127112.877539:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3485696 granted 17886912 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789127112.877579:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276855168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127112.877587:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789127112.877604:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127112.877633:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276855168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127112.878556:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276855296:0@lo:400:kworker.0 00000100:00100000:2.0:1789127112.878602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127112.878732:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276855296 00000100:00100000:0.0:1789127112.878738:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276855296 00000100:00100000:0.0:1789127112.878787:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789127112.878796:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3639:x1876035276855296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.878963:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276855424:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.878996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.879017:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276855936:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.879082:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276856448:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879105:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.879125:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789127112.879131:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276855808:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879154:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.879173:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276856320:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.879219:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276855424 00000100:00100000:3.0:1789127112.879223:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276855424 00000100:00100000:3.0:1789127112.879259:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789127112.879266:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276855424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879308:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276855424:12345-0@lo:400:kworker.0 Request processed in 42us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.879315:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789127112.879336:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276855936 00000100:00100000:3.0:1789127112.879340:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276855936 00000100:00100000:3.0:1789127112.879365:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276856448 00000100:00100000:3.0:1789127112.879367:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276856448 00000100:00100000:3.0:1789127112.879388:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276856320 00000100:00100000:3.0:1789127112.879390:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276856320 00000100:00100000:3.0:1789127112.879401:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789127112.879407:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276855936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879435:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276855936:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.879440:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789127112.879451:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789127112.879456:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276856448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879478:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276856448:12345-0@lo:400:kworker.0 Request processed in 23us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.879483:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789127112.879492:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127112.879497:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e856580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276856320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879521:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e856580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276856320:12345-0@lo:400:kworker.0 Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.879526:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127112.879548:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276855808 00000100:00100000:3.0:1789127112.879557:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276855808 00000100:00100000:3.0:1789127112.879583:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127112.879590:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e856940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276855808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879621:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e856940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276855808:12345-0@lo:400:kworker.0 Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.879627:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127112.879682:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276855552:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879707:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.879722:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276856064:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879741:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.879754:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789127112.879775:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276855680:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879799:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.879814:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276856192:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127112.879851:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276855552 00000100:00100000:3.0:1789127112.879854:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276855552 00000100:00100000:3.0:1789127112.879873:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276856064 00000100:00100000:3.0:1789127112.879875:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276856064 00000100:00100000:3.0:1789127112.879886:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276856192 00000100:00100000:3.0:1789127112.879888:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276856192 00000100:00100000:3.0:1789127112.879899:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127112.879905:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e857840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276855552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879936:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e857840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276855552:12345-0@lo:400:kworker.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.879943:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127112.879953:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789127112.879968:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276856064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.879997:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276856064:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.880003:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789127112.880014:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789127112.880021:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276856192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.880058:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276856192:12345-0@lo:400:kworker.0 Request processed in 38us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.880065:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789127112.880084:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276855680 00000100:00100000:3.0:1789127112.880088:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276855680 00000100:00100000:3.0:1789127112.880109:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127112.880114:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e857c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276855680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.880146:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e857c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276855680:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127112.880152:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127112.880195:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276855808:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.880205:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276856320:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.880215:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276855424:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.880224:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276855936:0@lo:400:kworker.0 00010000:00080000:3.0:1789127112.880237:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104af9e00 x1876035276856448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127112.880247:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276856448:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.880296:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276855680:0@lo:400:kworker.0 00010000:00080000:3.0:1789127112.880304:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410501de00 x1876035276856192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127112.880313:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276856192:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.880322:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276855552:0@lo:400:kworker.0 00000100:00100000:3.0:1789127112.880330:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276856064:0@lo:400:kworker.0 00000100:00100000:0.0:1789127112.883139:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3639:x1876035276855296:12345-0@lo:400:kworker.0 Request processed in 4333us (4525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127112.883154:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1789127112.883215:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127112.883221:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127112.883312:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276855296:0@lo:400:kworker.0 00000100:00100000:3.0:1789127113.040911:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127113.040960:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127113.041012:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127113.041034:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127113.041058:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127113.041091:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127113.041241:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258956928 00000100:00100000:3.0:1789127113.041252:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258956928 00000100:00100000:3.0:1789127113.041320:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258957184 00000100:00100000:3.0:1789127113.041323:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258957184 00000100:00100000:3.0:1789127113.041354:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258956800 00000100:00100000:3.0:1789127113.041357:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258956800 00000100:00100000:3.0:1789127113.041379:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258957312 00000100:00100000:3.0:1789127113.041382:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258957312 00000100:00100000:3.0:1789127113.041403:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:3.0:1789127113.041418:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e856d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258956928:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127113.041436:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:1.0:1789127113.041465:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e855680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2394:x1876035258957184:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127113.041510:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e856d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258956928:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 95us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127113.041521:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 86 00000100:00100000:3.0:1789127113.041559:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:3.0:1789127113.041569:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+13:2394:x1876035258956800:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127113.041581:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e855680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2394:x1876035258957184:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 127us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127113.041592:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 87 00000100:00100000:3.0:1789127113.041618:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+13:2394:x1876035258956800:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 48us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127113.041629:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:1.0:1789127113.041671:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e855a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2394:x1876035258957312:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127113.041706:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e855a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2394:x1876035258957312:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 68us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127113.041843:0:17872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258956672 00000100:00100000:2.0:1789127113.041851:0:17872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258956672 00000100:00100000:2.0:1789127113.041894:0:17872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:2.0:1789127113.041902:0:17872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2394:x1876035258956672:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127113.043043:0:17872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2394:x1876035258956672:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 1133us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127113.043055:0:17872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 173 00000100:00100000:3.0:1789127113.046465:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 88 00000100:00100000:1.0:1789127113.046485:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 89 00000100:00100000:3.0:1789127113.046547:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258957056 00000100:00100000:3.0:1789127113.046557:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258957056 00000100:00100000:3.0:1789127113.046635:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1789127113.046680:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258957056:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127113.046784:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2394:x1876035258957056:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 134us (5723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127113.046794:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00080000:3.0:1789127113.046826:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127113.046832:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127113.046837:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789127113.770978:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789127113.907238:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85b3b52e-7532-42e2-9665-c726ed80b63f 00000020:00000080:3.0:1789127113.907251:0:19382:0:(genops.c:885:class_export_put()) final put ffff994102cc7000/85b3b52e-7532-42e2-9665-c726ed80b63f 00000020:00000080:1.0:1789127113.907329:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994102cc7000/85b3b52e-7532-42e2-9665-c726ed80b63f for lustre-OST0000 00000020:00000080:1.0:1789127113.907401:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102f32000 for lustre-OST0000 00000001:00100000:2.0:1789127113.907468:0:20203:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85b3b52e-7532-42e2-9665-c726ed80b63f 00000020:00000080:2.0:1789127113.907474:0:20203:0:(genops.c:885:class_export_put()) final put ffff994220b33800/85b3b52e-7532-42e2-9665-c726ed80b63f 00000001:00100000:2.0:1789127113.907508:0:20203:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 51fd9021-bb15-44c1-9135-323c18d5cef9 00000020:00000080:2.0:1789127113.907510:0:20203:0:(genops.c:885:class_export_put()) final put ffff9941030ca000/51fd9021-bb15-44c1-9135-323c18d5cef9 00000020:00000080:3.0:1789127113.907575:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994220b33800/85b3b52e-7532-42e2-9665-c726ed80b63f for lustre-OST0001 00000020:00000080:3.0:1789127113.907608:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941030ca000/51fd9021-bb15-44c1-9135-323c18d5cef9 for lustre-OST0001 00000020:00000080:3.0:1789127113.907634:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994220b34800 for lustre-OST0001 00000020:00000080:3.0:1789127113.907640:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941030cd800 for lustre-OST0001 00010000:00010000:3.0:1789127114.794919:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127115.119440:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127115.119809:0:17879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258957568 00000100:00100000:2.0:1789127115.119819:0:17879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258957568 00000100:00100000:2.0:1789127115.119936:0:17879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1789127115.119948:0:17879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+13:16599:x1876035258957568:12345-192.168.203.23@tcp:35:umount.0 00000001:00080000:2.0:1789127115.121288:0:17879:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:2.0:1789127115.121452:0:17879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:51fd9021-bb15-44c1-9135-323c18d5cef9+15:16599:x1876035258957568:12345-192.168.203.23@tcp:35:umount.0 Request processed in 1503us (2016us total) trans 8589934625 rc 0/0 00000100:00100000:2.0:1789127115.121462:0:17879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000020:00080000:2.0:1789127115.121468:0:17879:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1789127115.122116:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127115.126937:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127115.126995:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127115.127069:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127115.137078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127115.137166:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258958080 00000100:00100000:3.0:1789127115.137174:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258958080 00000100:00100000:3.0:1789127115.137321:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:3.0:1789127115.137331:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2390:x1876035258958080:12345-192.168.203.23@tcp:9:umount.0 00000020:00000080:3.0:1789127115.137365:0:19387:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ec03c 00000100:00080000:3.0:1789127115.137374:0:19387:0:(import.c:65:import_set_state_nolock()) ffff994102cc1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127115.137424:0:19387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789127115.137679:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:51fd9021-bb15-44c1-9135-323c18d5cef9+2:2390:x1876035258958080:12345-192.168.203.23@tcp:9:umount.0 Request processed in 319us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127115.137688:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00080000:3.0:1789127115.137711:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789127115.137837:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127115.138927:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258957696 00000100:00100000:1.0:1789127115.138935:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258957696 00000100:00100000:1.0:1789127115.138995:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258957824 00000100:00100000:1.0:1789127115.139000:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258957824 00000100:00100000:3.0:1789127115.139010:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258957952 00000100:00100000:3.0:1789127115.139016:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258957952 00000100:00100000:1.0:1789127115.139025:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:1.0:1789127115.139038:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5f1ff69-7009-445c-9381-4cde4482fa5e+15:2391:x1876035258957696:12345-192.168.203.23@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789127115.139046:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00010000:00010000:1.0:1789127115.139051:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789127115.139057:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423d1a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5f1ff69-7009-445c-9381-4cde4482fa5e+15:2391:x1876035258957824:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127115.139065:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127115.139072:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588200/0xa840b4da666ec019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c76e expref: 15 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127115.139078:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67200/0xa840b4da666ec0dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c855 expref: 15 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.139093:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127115.139105:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127115.139141:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5f1ff69-7009-445c-9381-4cde4482fa5e+13:2391:x1876035258957696:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 106us (12212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127115.139148:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:1.0:1789127115.139164:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:1.0:1789127115.139185:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e855e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5f1ff69-7009-445c-9381-4cde4482fa5e+12:2394:x1876035258957952:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127115.139194:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127115.139204:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589000/0xa840b4da666ec020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c79f expref: 12 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.139214:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127115.139276:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423d1a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:2391:x1876035258957824:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 219us (12277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127115.139277:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e855e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5f1ff69-7009-445c-9381-4cde4482fa5e+11:2394:x1876035258957952:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 89us (12203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127115.139293:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:1.0:1789127115.139300:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:2.0:1789127115.141876:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127115.142158:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258958976 00000100:00100000:3.0:1789127115.142174:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258958976 00000100:00100000:3.0:1789127115.142322:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 67 00000100:00100000:3.0:1789127115.142348:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+15:2390:x1876035258958976:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:3.0:1789127115.142394:0:19940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ec02e 00000020:00010000:3.0:1789127115.142416:0:19940:0:(genops.c:1921:obd_stale_export_put()) Put export ffff994103e21800: total 0 00000100:00080000:3.0:1789127115.142422:0:19940:0:(import.c:65:import_set_state_nolock()) ffff994103e23000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127115.142454:0:19940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:3.0:1789127115.142738:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:51fd9021-bb15-44c1-9135-323c18d5cef9+14:2390:x1876035258958976:12345-192.168.203.23@tcp:39:umount.0 Request processed in 391us (869us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1789127115.142760:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 67 00000020:00010000:1.0:1789127115.143170:0:20291:0:(genops.c:1907:obd_stale_export_get()) Get export ffff994103e21800: total 0 00010000:00010000:1.0:1789127115.143243:0:20291:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994103e21800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789127115.143281:0:20291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994102e06300) 00010000:00010000:1.0:1789127115.143285:0:20291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127115.143295:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb000/0xa840b4da666ec0f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c85c expref: 13 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.143323:0:20291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff994103eab700) 00010000:00010000:1.0:1789127115.143326:0:20291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789127115.143330:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104397c00/0xa840b4da666ec1d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c89b expref: 12 pid: 17876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.143345:0:20291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:1.0:1789127115.143347:0:20291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127115.143351:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec288 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8da expref: 11 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.143366:0:20291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99410261f400) 00010000:00010000:1.0:1789127115.143368:0:20291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127115.143383:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3e00/0xa840b4da666ec115 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c863 expref: 10 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.143398:0:20291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:1.0:1789127115.143400:0:20291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789127115.143403:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca800/0xa840b4da666ec257 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8c5 expref: 9 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.143413:0:20291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff994102e06b00) 00010000:00010000:1.0:1789127115.143415:0:20291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127115.143418:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ec345 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c912 expref: 8 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.143430:0:20291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:1.0:1789127115.143432:0:20291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127115.143435:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2a00/0xa840b4da666ec154 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c871 expref: 7 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.143445:0:20291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff994102e06100) 00010000:00010000:1.0:1789127115.143448:0:20291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127115.143451:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cbe00/0xa840b4da666ec2e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c8ef expref: 6 pid: 20680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127115.143464:0:20291:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994103e21800, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1789127115.143478:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127115.143480:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127115.143482:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127115.150319:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127115.150422:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258959104 00000100:00100000:3.0:1789127115.150435:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258959104 00000100:00100000:3.0:1789127115.150514:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 68 00000100:00080000:0.0:1789127115.150518:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127115.150528:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+5:2390:x1876035258959104:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:3.0:1789127115.150571:0:20680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ec035 00000100:00080000:3.0:1789127115.150588:0:20680:0:(import.c:65:import_set_state_nolock()) ffff994103e20800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127115.150619:0:20680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1789127115.150621:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127115.151029:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:51fd9021-bb15-44c1-9135-323c18d5cef9+3:2390:x1876035258959104:12345-192.168.203.23@tcp:39:umount.0 Request processed in 504us (724us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789127115.151040:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 68 00010000:00010000:3.0:1789127115.819285:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127115.947028:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127115.947054:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276856576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127115.947177:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127115.947621:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276856576 00000100:00100000:0.0:1789127115.947630:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276856576 00000100:00100000:0.0:1789127115.947714:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127115.947723:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276856576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127115.947766:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789127115.947905:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276856576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 182us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127115.947913:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789127115.948379:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276856576:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789127116.079815:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789127116.143341:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127116.143544:0:20223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258959232 00000100:00100000:0.0:1789127116.143554:0:20223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258959232 00000100:00100000:0.0:1789127116.143631:0:20223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1789127116.143640:0:20223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:2391:x1876035258959232:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127116.143694:0:20223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127116.143714:0:20223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364ca600/0xa840b4da666ec058 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c7de expref: 10 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127116.143730:0:20223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127116.143795:0:20223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5f1ff69-7009-445c-9381-4cde4482fa5e+9:2391:x1876035258959232:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 157us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127116.143804:0:20223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:0.0:1789127116.151762:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127116.151895:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127116.151931:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127116.151973:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258959360 00000100:00100000:0.0:1789127116.151981:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258959360 00000100:00100000:0.0:1789127116.152028:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258959488 00000100:00100000:0.0:1789127116.152031:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258959488 00000100:00100000:0.0:1789127116.152051:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789127116.152060:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5f1ff69-7009-445c-9381-4cde4482fa5e+10:2393:x1876035258959360:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127116.152076:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127116.152096:0:17863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589e00/0xa840b4da666ec05f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c80f expref: 10 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127116.152112:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127116.152153:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5f1ff69-7009-445c-9381-4cde4482fa5e+9:2393:x1876035258959360:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 94us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127116.152161:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789127116.152547:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1789127116.152566:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5f1ff69-7009-445c-9381-4cde4482fa5e+8:2394:x1876035258959488:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127116.152575:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127116.152584:0:17863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67400/0xa840b4da666ec0d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c84e expref: 8 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127116.152594:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127116.152613:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5f1ff69-7009-445c-9381-4cde4482fa5e+7:2394:x1876035258959488:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 49us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127116.152620:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1789127116.153220:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258959744 00000100:00100000:3.0:1789127116.153227:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258959744 00000100:00100000:3.0:1789127116.153289:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00100000:3.0:1789127116.153297:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+6:2390:x1876035258959744:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:3.0:1789127116.153345:0:17876:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ec06d 00000020:00010000:3.0:1789127116.153354:0:17876:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9941030cf800: total 0 00000100:00080000:3.0:1789127116.153359:0:17876:0:(import.c:65:import_set_state_nolock()) ffff9941030c8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127116.153386:0:17876:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:1.0:1789127116.153694:0:20291:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9941030cf800: total 0 00010000:00010000:1.0:1789127116.153699:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127116.153752:0:20291:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9941030cf800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789127116.153782:0:20291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99410261f500) 00010000:00010000:1.0:1789127116.153785:0:20291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127116.153793:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994104396400/0xa840b4da666ec162 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c878 expref: 5 pid: 19940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127116.153815:0:20291:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9941030cf800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789127116.153826:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127116.153827:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127116.153829:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127116.154796:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85b3b52e-7532-42e2-9665-c726ed80b63f+3:2390:x1876035258959744:12345-192.168.203.23@tcp:39:umount.0 Request processed in 1494us (2859us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1789127116.154808:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 69 00000100:00080000:0.0:1789127116.154920:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127116.165959:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127116.166150:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258959872 00000100:00100000:3.0:1789127116.166168:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258959872 00000100:00100000:3.0:1789127116.166324:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00100000:3.0:1789127116.166338:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85b3b52e-7532-42e2-9665-c726ed80b63f+5:2390:x1876035258959872:12345-192.168.203.23@tcp:39:umount.0 00000020:00000080:3.0:1789127116.166393:0:19940:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ec074 00000100:00080000:3.0:1789127116.166405:0:19940:0:(import.c:65:import_set_state_nolock()) ffff9942064b2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127116.166456:0:19940:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:2.0:1789127116.166804:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127116.166990:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85b3b52e-7532-42e2-9665-c726ed80b63f+3:2390:x1876035258959872:12345-192.168.203.23@tcp:39:umount.0 Request processed in 650us (1044us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789127116.167004:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 70 00000100:00080000:0.0:1789127116.169157:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127116.182937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127116.183348:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258960128 00000100:00100000:0.0:1789127116.183361:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258960128 00000100:00100000:0.0:1789127116.183440:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 174 00000100:00100000:0.0:1789127116.183452:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d93bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+7:2390:x1876035258960128:12345-192.168.203.23@tcp:251:umount.0 00000020:00000080:0.0:1789127116.183499:0:17871:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ec00b 00000020:00010000:0.0:1789127116.183507:0:17871:0:(genops.c:1921:obd_stale_export_put()) Put export ffff994103e26800: total 0 00000100:00080000:0.0:1789127116.183511:0:17871:0:(import.c:65:import_set_state_nolock()) ffff994103e27800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789127116.183594:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d93bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5f1ff69-7009-445c-9381-4cde4482fa5e+3:2390:x1876035258960128:12345-192.168.203.23@tcp:251:umount.0 Request processed in 144us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127116.183605:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 174 00000020:00010000:3.0:1789127116.184553:0:17866:0:(genops.c:1907:obd_stale_export_get()) Get export ffff994103e26800: total 0 00010000:00010000:3.0:1789127116.184677:0:17866:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994103e26800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789127116.184728:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67c00/0xa840b4da666ec012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c767 expref: 2 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127116.184765:0:17866:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994103e26800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789127116.184779:0:17866:0:(genops.c:885:class_export_put()) final put ffff994103e26800/d5f1ff69-7009-445c-9381-4cde4482fa5e 00010000:00010000:3.0:1789127116.184808:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127116.184811:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127116.184814:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789127116.184864:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994103e26800/d5f1ff69-7009-445c-9381-4cde4482fa5e for MGS 00000020:00000080:1.0:1789127116.184916:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994103e27800 for MGS 00000100:00100000:3.0:1789127116.463102:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276856704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127116.463241:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127116.463511:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276856704 00000100:00100000:1.0:1789127116.463528:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276856704 00000100:00100000:1.0:1789127116.463618:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789127116.463628:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276856704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127116.463688:0:17881:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127116.463757:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941041ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276856704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127116.463764:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789127116.463827:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276856704:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789127116.842926:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127116.971489:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276856832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127116.971559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127116.971697:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276856832 00000100:00100000:1.0:1789127116.971704:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276856832 00000100:00100000:1.0:1789127116.971781:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127116.971791:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276856832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127116.971818:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00080000:3.0:1789127116.971906:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127116.980512:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276856832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8716us (8945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127116.980524:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127116.981746:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276856832:0@lo:13:osp-pre-0-1.0 00000020:01000004:3.0:1789127117.825794:0:21459:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789127117.844894:0:21459:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789127117.844951:0:21459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.844966:0:21459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.844975:0:21459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.844982:0:21459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.844999:0:21459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789127117.845004:0:21459:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789127117.845040:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127117.845045:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789127117.845051:0:21459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789127117.845076:0:21459:0:(import.c:65:import_set_state_nolock()) ffff994210e00800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789127117.845128:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276856960:0@lo:39:umount.0 00000100:00100000:0.0:1789127117.845213:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.845304:0:20680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276856960 00000100:00100000:3.0:1789127117.845312:0:20680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276856960 00000100:00100000:3.0:1789127117.845361:0:20680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789127117.845372:0:20680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941043d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876035276856960:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789127117.845398:0:20680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebbff 00000100:00080000:3.0:1789127117.845406:0:20680:0:(import.c:65:import_set_state_nolock()) ffff9942118e3000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789127117.845510:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127117.845517:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.845527:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789127117.845531:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.845541:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127117.845557:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127117.845563:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127117.845566:0:17865:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789127117.845569:0:17865:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789127117.845600:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.845609:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127117.845631:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.845639:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ebbce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebbd5 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.845675:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127117.845678:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127117.845680:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127117.845692:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276857088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127117.845747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127117.845797:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276857088 00000100:00100000:2.0:1789127117.845801:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276857088 00000100:00100000:2.0:1789127117.845835:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127117.845842:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104061e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3640:x1876035276857088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127117.845852:0:17863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127117.845867:0:17863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104396200/0xa840b4da666ebbd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebbce expref: 24 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.845889:0:17863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127117.845919:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104061e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:3640:x1876035276857088:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127117.845928:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127117.845976:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941043e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276857088:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127117.846033:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127117.846334:0:20680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941043d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3638:x1876035276856960:12345-0@lo:39:umount.0 Request processed in 963us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127117.846342:0:20680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1789127117.846351:0:20680:0:(genops.c:885:class_export_put()) final put ffff994104281000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789127117.846426:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994104281000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789127117.846480:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942118e3000 for lustre-MDT0000 00000100:00080000:0.0:1789127117.846620:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994210e00800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789127117.846739:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276856960:0@lo:39:umount.0 00000100:00080000:2.0:1789127117.846917:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127117.846921:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789127117.846925:0:21459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789127117.848947:0:21459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.848964:0:21459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.848971:0:21459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.848978:0:21459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.848997:0:21459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127117.849002:0:21459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.849009:0:21459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.849027:0:21459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.849033:0:21459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.849089:0:21459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789127117.849096:0:21459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.849103:0:21459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.849110:0:21459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127117.849117:0:21459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849144:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789127117.849151:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849158:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127117.849162:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849171:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127117.849178:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127117.849184:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127117.849187:0:17865:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789127117.849214:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849221:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127117.849246:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849253:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104397000/0xa840b4da666ebb1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebb26 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849267:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127117.849271:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849276:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b67e00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127117.849285:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849292:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127117.849298:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127117.849303:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127117.849306:0:17865:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789127117.849308:0:17865:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789127117.849322:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849328:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127117.849334:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849341:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104b67e00/0xa840b4da666ebffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ec004 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849349:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127117.849352:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849358:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66800 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127117.849361:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849367:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127117.849378:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127117.849384:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789127117.849386:0:17865:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789127117.849396:0:17865:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849401:0:17865:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127117.849415:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.849423:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127117.849424:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127117.849426:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127117.849445:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276857216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127117.849713:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.849770:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127117.849777:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276857344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127117.849803:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.849832:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276857472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127117.849854:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.849886:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276857216 00000100:00100000:3.0:1789127117.849892:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276857216 00000100:00100000:3.0:1789127117.849931:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276857344 00000100:00100000:3.0:1789127117.849935:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276857344 00000100:00100000:3.0:1789127117.849947:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276857472 00000100:00100000:3.0:1789127117.849949:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276857472 00000100:00100000:3.0:1789127117.849975:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127117.849982:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+25:3641:x1876035276857216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127117.849995:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127117.850007:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b66400/0xa840b4da666ebb26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebb1f expref: 25 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.850020:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127117.850050:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+24:3641:x1876035276857216:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127117.850057:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127117.850071:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127117.850077:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423d1a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+23:3641:x1876035276857344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127117.850084:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127117.850093:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588600/0xa840b4da666ec004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebffd expref: 23 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.850102:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127117.850122:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423d1a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+22:3641:x1876035276857344:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127117.850128:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127117.850169:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127117.850175:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+21:3639:x1876035276857472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127117.850182:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127117.850189:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364ca400/0xa840b4da666ec0cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ec0c8 expref: 21 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.850198:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127117.850229:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:3639:x1876035276857472:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127117.850236:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127117.850272:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3639:1876035276857472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127117.850292:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276857344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127117.850298:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3641:1876035276857216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127117.854531:0:21459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789127117.854546:0:21459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104b66800/0xa840b4da666ec0c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ec0cf expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127117.854567:0:21459:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789127117.855533:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127117.855552:0:21459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.855564:0:21459:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.855572:0:21459:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.855579:0:21459:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.855605:0:21459:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789127117.855610:0:21459:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789127117.855614:0:21459:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789127117.855678:0:21459:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789127117.855682:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789127117.855688:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127117.855693:0:21459:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789127117.855701:0:21459:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9941049bc000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127117.855708:0:21459:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9941030c8000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127117.855736:0:21459:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff994205df9000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127117.855740:0:21459:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99422f9e9800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127117.855746:0:21459:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9941030cf800 85b3b52e-7532-42e2-9665-c726ed80b63f 192.168.203.23@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1789127117.855751:0:21459:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff994103e21800 51fd9021-bb15-44c1-9135-323c18d5cef9 192.168.203.23@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1789127117.855755:0:21459:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff994103ecb490) has exports, disconnecting them 00000020:00080000:3.0:1789127117.855759:0:21459:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9941049bc000), last request at 1789127112 00000020:00000080:3.0:1789127117.855766:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebe36 00000100:00080000:3.0:1789127117.855783:0:21459:0:(import.c:65:import_set_state_nolock()) ffff9941049bb000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789127117.855839:0:21459:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9941049bc000): rc 0 00000020:00000080:3.0:1789127117.855841:0:21459:0:(genops.c:885:class_export_put()) final put ffff9941049bc000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789127117.855868:0:21459:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9941030c8000), last request at 1789127112 00000020:00000080:3.0:1789127117.855872:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebd9c 00000100:00080000:3.0:1789127117.855877:0:21459:0:(import.c:65:import_set_state_nolock()) ffff9941030cc000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789127117.855891:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127117.855897:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.855904:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127117.855907:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.855916:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127117.855923:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127117.855940:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127117.855943:0:17866:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789127117.855944:0:17866:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789127117.855977:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.855983:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127117.856004:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.856011:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104397400/0xa840b4da666ebb11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebb18 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.856022:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127117.856024:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127117.856026:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127117.856040:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276857600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127117.856196:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789127117.856253:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9941049bc000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1789127117.856267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789127117.856313:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941049bb000 for lustre-MDT0000 00000100:00100000:3.0:1789127117.856348:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276857600 00000100:00100000:3.0:1789127117.856355:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276857600 00000100:00100000:3.0:1789127117.856409:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127117.856418:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+20:3640:x1876035276857600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127117.856430:0:17862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127117.856443:0:17862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67a00/0xa840b4da666ebb18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebb11 expref: 20 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127117.856455:0:17862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127117.856497:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:3640:x1876035276857600:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127117.856511:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000020:00080000:3.0:1789127117.856536:0:21459:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9941030c8000): rc 0 00000020:00000080:3.0:1789127117.856539:0:21459:0:(genops.c:885:class_export_put()) final put ffff9941030c8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789127117.856547:0:21459:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff994205df9000), last request at 1789127044 00000020:00000080:3.0:1789127117.856551:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebced 00000100:00080000:3.0:1789127117.856555:0:21459:0:(import.c:65:import_set_state_nolock()) ffff994205dfa800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789127117.856568:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789127117.856576:0:21459:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994205df9000): rc 0 00000020:00000080:3.0:1789127117.856578:0:21459:0:(genops.c:885:class_export_put()) final put ffff994205df9000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789127117.856582:0:21459:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99422f9e9800), last request at 1789127044 00000020:00000080:3.0:1789127117.856585:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc84 00000100:00080000:3.0:1789127117.856589:0:21459:0:(import.c:65:import_set_state_nolock()) ffff99423d062800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127117.856600:0:21459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00000080:2.0:1789127117.856616:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941030c8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789127117.856673:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994205df9000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00080000:3.0:1789127117.856700:0:21459:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99422f9e9800): rc 0 00000020:00000080:2.0:1789127117.856703:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941030cc000 for lustre-MDT0000 00000004:00000080:3.0:1789127117.856707:0:21459:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb3054183fae0 00000020:00000080:2.0:1789127117.856716:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994205dfa800 for lustre-MDT0000 00010000:00010000:2.0:1789127117.856738:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127117.856739:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789127117.856743:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789127117.857019:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276857600:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789127117.860701:0:21459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789127117.860749:0:21459:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789127117.860826:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276857728:0@lo:39:umount.0 00000100:00100000:0.0:1789127117.860893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127117.861179:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789127117.861184:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1789127117.861204:0:21459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789127117.861209:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276857728 00000100:00100000:3.0:1789127117.861217:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276857728 00000100:00100000:3.0:1789127117.861267:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1789127117.861268:0:21459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789127117.861277:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876035276857728:12345-0@lo:39:umount.0 00000100:00080000:0.0:1789127117.861282:0:21459:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789127117.861297:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789127117.861300:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000020:00000080:3.0:1789127117.861304:0:17882:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebd17 00000004:00080000:0.0:1789127117.861308:0:21459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789127117.861313:0:17882:0:(import.c:65:import_set_state_nolock()) ffff9942064b6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127117.861336:0:17882:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789127117.861388:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276857856:0@lo:9:umount.0 00000100:00100000:0.0:1789127117.861423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.861453:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3638:x1876035276857728:12345-0@lo:39:umount.0 Request processed in 177us (558us total) trans 8589934595 rc 0/0 00000100:00080000:0.0:1789127117.861471:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994104282800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789127117.861477:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789127117.861482:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276857728:0@lo:39:umount.0 00010000:00010000:3.0:1789127117.861506:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127117.861508:0:21459:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789127117.861520:0:21459:0:(import.c:65:import_set_state_nolock()) ffff99422043b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789127117.861569:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276857984:0@lo:9:umount.0 00000100:00100000:3.0:1789127117.861599:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127117.861612:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127117.861667:0:20286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276857856 00000100:00100000:2.0:1789127117.861673:0:20286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276857856 00000020:00080000:0.0:1789127117.861735:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff994103ecb490) has no exports 00000100:00100000:3.0:1789127117.861767:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276857984 00000100:00100000:3.0:1789127117.861772:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276857984 00000100:00080000:0.0:1789127117.861790:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127117.861794:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127117.861900:0:20286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127117.861911:0:20286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1876035276857856:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789127117.861917:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127117.861928:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876035276857984:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789127117.861930:0:20286:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebe59 00000100:00080000:2.0:1789127117.861939:0:20286:0:(import.c:65:import_set_state_nolock()) ffff994102c7a800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789127117.861943:0:19386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebe60 00000100:00080000:3.0:1789127117.861950:0:19386:0:(import.c:65:import_set_state_nolock()) ffff994102c7f000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789127117.861967:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789127117.861979:0:20286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000001:00000004:3.0:1789127117.861994:0:19386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789127117.862193:0:20286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3638:x1876035276857856:12345-0@lo:9:umount.0 Request processed in 284us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127117.862196:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423675f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3638:x1876035276857984:12345-0@lo:9:umount.0 Request processed in 269us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127117.862206:0:20286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789127117.862209:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422043b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789127117.862216:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:0.0:1789127117.862219:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789127117.862222:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127117.862225:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276857984:0@lo:9:umount.0 00000100:00080000:0.0:1789127117.862236:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1789127117.862237:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789127117.862244:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789127117.862246:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127117.862248:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276857856:0@lo:9:umount.0 00010000:00010000:1.0:1789127117.862774:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127117.866895:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789127117.879596:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff994103ecb490) has no exports 00000020:00000080:0.0:1789127117.912518:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb6c 00000020:00000080:0.0:1789127117.912533:0:21459:0:(genops.c:885:class_export_put()) final put ffff994104284800/lustre-QMT0000_UUID 00000020:01000000:0.0:1789127117.912555:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789127117.912634:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127117.912644:0:21459:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789127117.912688:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff99422d564ed8) has no exports 00000020:00000080:2.0:1789127117.912778:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994104284800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789127117.914128:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb65 00000020:00000080:0.0:1789127117.914138:0:21459:0:(genops.c:885:class_export_put()) final put ffff9941032b7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789127117.914204:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127117.914214:0:21459:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789127117.914217:0:21459:0:(genops.c:885:class_export_put()) final put ffff994238d0b000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789127117.914220:0:21459:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789127117.914230:0:21459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789127117.914346:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9941032b7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1789127117.994941:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e855e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276858240:0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.995010:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127117.995258:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276858112:0@lo:400:kworker.0 00000100:00100000:2.0:1789127117.995292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.995794:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276858752:0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.995825:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127117.995947:0:17876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276858752 00000100:00100000:1.0:1789127117.995955:0:17876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276858752 00000100:00100000:1.0:1789127117.996011:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789127117.996021:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276858752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127117.996082:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276858752:12345-0@lo:400:kworker.0 Request processed in 63us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127117.996090:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1789127117.996112:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789127117.996230:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104af9e00 x1876035276858752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127117.996244:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276858752:0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.996258:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127117.996265:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276859136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127117.996304:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.996343:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276858368:0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.996367:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.996386:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276858880:0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.996407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.996426:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789127117.996433:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276858496:0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.996454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.996472:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276859008:0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.996492:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127117.996559:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276858240 00000100:00100000:3.0:1789127117.996563:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276858240 00000100:00100000:3.0:1789127117.996592:0:19941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276858368 00000100:00100000:3.0:1789127117.996595:0:19941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276858368 00000100:00100000:3.0:1789127117.996620:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127117.996627:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276858240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.996695:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276858240:12345-0@lo:400:kworker.0 Request processed in 68us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127117.996702:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127117.996715:0:19941:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127117.996721:0:19941:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276858368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.996764:0:19941:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276858368:12345-0@lo:400:kworker.0 Request processed in 43us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127117.996770:0:19941:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127117.996790:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276858880 00000100:00100000:3.0:1789127117.996794:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276858880 00000100:00100000:3.0:1789127117.996821:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276858496 00000100:00100000:3.0:1789127117.996824:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276858496 00000100:00100000:3.0:1789127117.996835:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276859008 00000100:00100000:3.0:1789127117.996838:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276859008 00000100:00100000:3.0:1789127117.996928:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789127117.996936:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276859008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127117.996968:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276859008:12345-0@lo:400:kworker.0 Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127117.996974:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789127117.996987:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789127117.996991:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1876035276858880:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789127117.996997:0:19940:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789127117.997021:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1876035276858880:12345-0@lo:400:kworker.0 Request processed in 29us (614us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789127117.997027:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789127117.997038:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789127117.997042:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1876035276858496:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789127117.997046:0:19940:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789127117.997506:0:20797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276859136 00000100:00100000:1.0:1789127117.997513:0:20797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276859136 00000100:00100000:1.0:1789127117.997544:0:20797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789127117.997552:0:20797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276859136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127117.997574:0:20797:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127117.997618:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1876035276858496:12345-0@lo:400:kworker.0 Request processed in 574us (1162us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789127117.997624:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789127117.997676:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127117.997680:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127117.997735:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789127117.997740:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9942405e9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789127117.997744:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1789127118.003793:0:17882:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276858112 00000100:00100000:0.0:1789127118.003808:0:17882:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276858112 00000100:00100000:0.0:1789127118.003866:0:17882:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789127118.003874:0:17882:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876035276858112:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789127118.003884:0:17882:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789127118.003976:0:20797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276859136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6422us (7668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127118.003987:0:20797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789127118.005976:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789127118.005983:0:3641:0:(import.c:65:import_set_state_nolock()) ffff99423d03f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789127118.005987:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789127118.005992:0:3641:0:(import.c:65:import_set_state_nolock()) ffff99423d03f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127118.005996:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1789127118.006004:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99423d03f000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127118.006032:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941040621c0 x1876035276859264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127118.006137:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423675f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276858112:0@lo:400:kworker.0 00000100:00100000:2.0:1789127118.006148:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276858624:0@lo:400:kworker.0 00000100:00100000:2.0:1789127118.006206:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127118.006271:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276858624 00000100:00100000:2.0:1789127118.006276:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276858624 00000100:00100000:2.0:1789127118.006310:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789127118.006317:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876035276858624:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789127118.006324:0:17875:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789127118.006357:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1876035276858624:12345-0@lo:400:kworker.0 Request processed in 39us (151us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789127118.006364:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789127118.006427:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789127118.006430:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9941030ce800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789127118.006433:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789127118.006437:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9941030ce800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127118.006440:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 486 00000100:00080000:2.0:1789127118.006444:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9941030ce800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127118.006457:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104062940 x1876035276859392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127118.006468:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276858624:0@lo:400:kworker.0 00000100:00100000:1.0:1789127118.007197:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276859264:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789127118.007244:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127118.007268:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276859392:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789127118.007290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127118.007331:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276859392 00000100:00100000:1.0:1789127118.007335:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276859392 00000100:00100000:1.0:1789127118.007361:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789127118.007367:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276859392:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789127118.007381:0:17877:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789127118.007461:0:17881:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789127118.007469:0:17881:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789127118.007591:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276859264 00000100:00100000:2.0:1789127118.007595:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276859264 00000100:00100000:2.0:1789127118.007705:0:21460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127118.007710:0:21460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1876035276859264:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1789127118.007718:0:21460:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789127118.007768:0:21460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1876035276859264:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 57us (524us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789127118.007781:0:21460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127118.007843:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276859136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127118.007857:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e855e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276858240:0@lo:400:kworker.0 00000100:00080000:2.0:1789127118.007891:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d03f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127118.007895:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127118.007899:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276859264:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789127118.009315:0:17882:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3641:x1876035276858112:12345-0@lo:400:kworker.0 Request processed in 5434us (14015us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789127118.009329:0:17882:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1789127118.014470:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9942405e9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127118.014496:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1789127118.014506:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9942405e9800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127118.014545:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501f840 x1876035276859520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127118.014612:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276859520:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789127118.014715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127118.015080:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276859520 00000100:00100000:0.0:1789127118.015095:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276859520 00000100:00100000:0.0:1789127118.015136:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789127118.015143:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276859520:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789127118.015159:0:17875:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789127118.015306:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276858496:0@lo:400:kworker.0 00010000:00080000:3.0:1789127118.015330:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ee0000 x1876035276859008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127118.015341:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276859008:0@lo:400:kworker.0 00000100:00100000:3.0:1789127118.015353:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276858368:0@lo:400:kworker.0 00000100:00080000:3.0:1789127118.015365:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789127118.015369:0:3639:0:(import.c:65:import_set_state_nolock()) ffff994102c7e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789127118.015372:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789127118.015376:0:3639:0:(import.c:65:import_set_state_nolock()) ffff994102c7e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127118.015380:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1789127118.015384:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994102c7e800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127118.015416:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422051d2c0 x1876035276859648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127118.019923:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276859648:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789127118.019997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127118.025961:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276859520:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 10806us (11235us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127118.025977:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789127118.026010:0:17875:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276859648 00000100:00100000:0.0:1789127118.026018:0:17875:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276859648 00000100:00100000:0.0:1789127118.026056:0:17875:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789127118.026062:0:17875:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104062580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276859648:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1789127118.028968:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942405e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127118.028981:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127118.028986:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276859520:0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789127118.029298:0:17875:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789127118.029386:0:17875:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104062580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276859648:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 3321us (9388us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127118.029396:0:17875:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789127118.029966:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102c7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127118.029972:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127118.029975:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276859648:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789127118.030045:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276858880:0@lo:400:kworker.0 00000100:00100000:1.0:1789127118.038875:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276859392:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 31497us (31573us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789127118.038892:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789127118.039207:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941030ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127118.039213:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789127118.039218:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276859392:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1789127118.890940:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127119.914904:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789127120.560377:0:17857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789127120.560388:0:17857:0:(genops.c:885:class_export_put()) final put ffff99422f9e9800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789127120.560410:0:17857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85b3b52e-7532-42e2-9665-c726ed80b63f 00000001:00080000:0.0:1789127120.560418:0:17857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1789127120.560421:0:17857:0:(genops.c:885:class_export_put()) final put ffff9941030cf800/85b3b52e-7532-42e2-9665-c726ed80b63f 00000001:00100000:0.0:1789127120.560426:0:17857:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 51fd9021-bb15-44c1-9135-323c18d5cef9 00000001:00080000:0.0:1789127120.560429:0:17857:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:0.0:1789127120.560434:0:17857:0:(genops.c:885:class_export_put()) final put ffff994103e21800/51fd9021-bb15-44c1-9135-323c18d5cef9 00000020:00000080:1.0:1789127120.560792:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99422f9e9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789127120.560869:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941030cf800/85b3b52e-7532-42e2-9665-c726ed80b63f for lustre-MDT0000 00000020:00000080:1.0:1789127120.560904:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994103e21800/51fd9021-bb15-44c1-9135-323c18d5cef9 for lustre-MDT0000 00000020:00000080:1.0:1789127120.560946:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99423d062800 for lustre-MDT0000 00000020:00000080:1.0:1789127120.560952:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941030c8800 for lustre-MDT0000 00000020:00000080:1.0:1789127120.560955:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994103e23000 for lustre-MDT0000 00000001:00100000:0.0:1789127120.563334:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789127120.563351:0:18613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1789127120.563358:0:18613:0:(genops.c:885:class_export_put()) final put ffff994205dfe000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789127120.563383:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 85b3b52e-7532-42e2-9665-c726ed80b63f 00000001:00080000:0.0:1789127120.563388:0:18613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1789127120.563406:0:18613:0:(genops.c:885:class_export_put()) final put ffff9941030ce000/85b3b52e-7532-42e2-9665-c726ed80b63f 00000001:00100000:0.0:1789127120.563413:0:18613:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 51fd9021-bb15-44c1-9135-323c18d5cef9 00000001:00080000:0.0:1789127120.563416:0:18613:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1789127120.563418:0:18613:0:(genops.c:885:class_export_put()) final put ffff994103e27000/51fd9021-bb15-44c1-9135-323c18d5cef9 00000020:00000080:2.0:1789127120.563509:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994205dfe000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1789127120.563591:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9941030ce000/85b3b52e-7532-42e2-9665-c726ed80b63f for lustre-MDT0001 00000020:00000080:2.0:1789127120.563619:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994103e27000/51fd9021-bb15-44c1-9135-323c18d5cef9 for lustre-MDT0001 00000020:00000080:2.0:1789127120.563667:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942064b6000 for lustre-MDT0001 00000020:00000080:2.0:1789127120.563672:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942064b2800 for lustre-MDT0001 00000020:00000080:2.0:1789127120.563675:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994103e20800 for lustre-MDT0001 00000001:00100000:3.0:1789127120.567347:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789127120.567357:0:19382:0:(genops.c:885:class_export_put()) final put ffff994102c7d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789127120.567373:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 51fd9021-bb15-44c1-9135-323c18d5cef9 00000020:00000080:3.0:1789127120.567375:0:19382:0:(genops.c:885:class_export_put()) final put ffff994102cc2800/51fd9021-bb15-44c1-9135-323c18d5cef9 00000020:00000080:1.0:1789127120.567934:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994102c7d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789127120.568000:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994102cc2800/51fd9021-bb15-44c1-9135-323c18d5cef9 for lustre-OST0000 00000020:00000080:1.0:1789127120.568023:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102c7a800 for lustre-OST0000 00000020:00000080:1.0:1789127120.568030:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102cc1000 for lustre-OST0000 00010000:00010000:0.0:1789127120.941379:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127121.962887:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127122.091472:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127122.093062:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276859776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127122.093140:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127122.093303:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276859776 00000100:00100000:2.0:1789127122.093326:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276859776 00000100:00100000:2.0:1789127122.093394:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127122.093404:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276859776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127122.093435:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1789127122.093490:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276859776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127122.093498:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789127122.093619:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127122.093799:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276859776:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789127122.987173:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127123.114900:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127123.117687:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276860032:0@lo:400:kworker.0 00000100:00100000:1.0:1789127123.117786:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127123.117858:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276859904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127123.117887:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127123.118044:0:17871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276860032 00000100:00100000:0.0:1789127123.118053:0:17871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276860032 00000100:00100000:0.0:1789127123.118105:0:17871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789127123.118114:0:17871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422d939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:3640:x1876035276860032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127123.118165:0:17871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422d939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0+19:3640:x1876035276860032:12345-0@lo:400:kworker.0 Request processed in 53us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127123.118172:0:17871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789127123.118411:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104063840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276860032:0@lo:400:kworker.0 00000100:00100000:3.0:1789127123.118497:0:19390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276859904 00000100:00100000:3.0:1789127123.118503:0:19390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276859904 00000100:00100000:3.0:1789127123.118562:0:19390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789127123.118571:0:19390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276859904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127123.118597:0:19390:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127123.118645:0:19390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276859904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127123.118681:0:19390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789127123.118910:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127123.118947:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276859904:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789127123.120825:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789127123.120834:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789127123.120837:0:37:0:(import.c:65:import_set_state_nolock()) ffff99423d03f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127123.120845:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1789127123.120851:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789127123.120858:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99423d03f000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127123.120895:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104060780 x1876035276860160/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127123.120951:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789127123.120955:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789127123.120956:0:37:0:(import.c:65:import_set_state_nolock()) ffff9942405e9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127123.120959:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1789127123.120962:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789127123.120965:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9942405e9800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127123.120977:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941040603c0 x1876035276860416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127123.120996:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789127123.120998:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1789127123.121096:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104063c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276860288:0@lo:400:kworker.0 00000100:00100000:0.0:1789127123.121156:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127123.121264:0:19386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276860288 00000100:00100000:1.0:1789127123.121270:0:19386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276860288 00000100:00100000:1.0:1789127123.121322:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789127123.121331:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276860288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127123.121380:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276860288:12345-0@lo:400:kworker.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127123.121387:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127123.121466:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104063c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276860288:0@lo:400:kworker.0 00000100:00080000:2.0:1789127123.121567:0:37:0:(import.c:65:import_set_state_nolock()) ffff9941030ce800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127123.121572:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1789127123.121575:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789127123.121580:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9941030ce800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127123.121593:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276860160:0@lo:38:kworker.0 00000100:00100000:2.0:1789127123.121599:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104060f00 x1876035276860544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127123.121634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789127123.121674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789127123.121679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789127123.121681:0:37:0:(import.c:65:import_set_state_nolock()) ffff994102c7e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127123.121685:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1789127123.121688:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1789127123.121699:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276860416:0@lo:38:kworker.0 00000100:00080000:2.0:1789127123.121708:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994102c7e800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127123.121722:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104061680 x1876035276860800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127123.121738:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127123.121767:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276860544:0@lo:38:kworker.0 00000100:00100000:2.0:1789127123.121776:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276860416 00000100:00100000:2.0:1789127123.121781:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276860416 00000100:00100000:3.0:1789127123.121793:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127123.121840:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276860672:0@lo:400:kworker.0 00000100:00100000:1.0:1789127123.121864:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127123.121871:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276860928:0@lo:400:kworker.0 00000100:00100000:0.0:1789127123.121912:0:17881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276860160 00000100:00100000:0.0:1789127123.121916:0:17881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276860160 00000100:00100000:0.0:1789127123.121940:0:17881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789127123.121945:0:17881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276860160:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789127123.121959:0:17881:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789127123.122629:0:19940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276860544 00000100:00100000:2.0:1789127123.122634:0:19940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276860544 00000100:00100000:2.0:1789127123.122678:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789127123.122683:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876035276860416:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1789127123.122702:0:19940:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789127123.122738:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876035276860416:12345-0@lo:38:kworker.0 Request processed in 54us (1002us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789127123.122744:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789127123.122757:0:19940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789127123.122761:0:19940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876035276860544:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1789127123.122779:0:19940:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789127123.122803:0:19940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876035276860544:12345-0@lo:38:kworker.0 Request processed in 40us (1011us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789127123.122809:0:19940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789127123.128515:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127123.128524:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941030ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127123.128532:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789127123.128537:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276860544:0@lo:38:kworker.0 00000100:00100000:3.0:1789127123.128548:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276860800:0@lo:38:kworker.0 00000100:00100000:3.0:1789127123.128619:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127123.128629:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276860928 00000100:00100000:1.0:1789127123.128636:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276860928 00000100:00080000:3.0:1789127123.128665:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942405e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127123.128669:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789127123.128673:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276860416:0@lo:38:kworker.0 00000100:00080000:1.0:1789127123.128685:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127123.128738:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276860800 00000100:00100000:1.0:1789127123.128742:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276860800 00000100:00100000:1.0:1789127123.128760:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789127123.128771:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276860928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127123.128836:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276860928:12345-0@lo:400:kworker.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127123.128844:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1789127123.128879:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9941040630c0 x1876035276860928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127123.128880:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127123.128894:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276860928:0@lo:400:kworker.0 00000100:00100000:1.0:1789127123.128915:0:17877:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276860672 00000100:00100000:1.0:1789127123.128919:0:17877:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276860672 00000100:00080000:1.0:1789127123.128952:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127123.128972:0:17877:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789127123.128980:0:17877:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276860672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127123.128998:0:17876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789127123.129016:0:17876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276860800:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1789127123.129032:0:17876:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789127123.129042:0:17877:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276860672:12345-0@lo:400:kworker.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127123.129049:0:17877:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789127123.129077:0:17876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276860800:12345-0@lo:38:kworker.0 Request processed in 61us (458us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789127123.129084:0:17876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1789127123.129112:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104062d00 x1876035276860672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127123.129122:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276860672:0@lo:400:kworker.0 00000100:00080000:2.0:1789127123.129522:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102c7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127123.129527:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127123.129530:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276860800:0@lo:38:kworker.0 00000100:00100000:0.0:1789127123.137118:0:17881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276860160:12345-0@lo:38:kworker.0 Request processed in 15161us (15475us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127123.137151:0:17881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789127123.137263:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d03f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127123.137269:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127123.137273:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276860160:0@lo:38:kworker.0 00000001:00100000:2.0:1789127123.643846:0:20203:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127123.643856:0:20203:0:(genops.c:885:class_export_put()) final put ffff994102c7b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789127123.643944:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994102c7b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789127123.644003:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102c7f000 for lustre-OST0001 00000020:01000000:1.0:1789127123.948245:0:21459:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994102c14ea0 - data ffff994231685d80/ffff99423cef3000 00000020:01000000:1.0:1789127123.948422:0:21459:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994104055ba0 - data ffff99423167aaf8/ffff99423e8b5c00 00000001:00000004:1.0:1789127123.957749:0:21459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00010000:00010000:2.0:1789127124.012371:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127124.015211:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789127124.015220:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789127124.015234:0:21459:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99423675f840 x1876035276857728/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789127127 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127124.015256:0:21459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789127124.016839:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789127124.016845:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1789127124.016860:0:21459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789127124.016863:0:21459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789127124.018780:0:17900:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789127124.018787:0:17900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1789127124.018800:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789127124.019432:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789127124.019437:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1789127124.020865:0:21459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789127124.020872:0:21459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789127124.022880:0:17902:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789127124.022887:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1789127124.022897:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789127124.024811:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb34 00000020:00000080:3.0:1789127124.024823:0:21459:0:(genops.c:885:class_export_put()) final put ffff994238d0f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789127124.026101:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb49 00000020:00000080:3.0:1789127124.026111:0:21459:0:(genops.c:885:class_export_put()) final put ffff99422ccaf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127124.026474:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789127124.026546:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789127124.026552:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127124.026559:0:21459:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789127124.026563:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff994103ec9a48) has no exports 00000004:01000000:3.0:1789127124.026747:0:21459:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789127124.026755:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebbab 00000020:00000080:3.0:1789127124.026760:0:21459:0:(genops.c:885:class_export_put()) final put ffff99422cca8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127124.026818:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccaf000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789127124.026916:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789127124.026921:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127124.026926:0:21459:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789127124.026929:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff994238d4b490) has no exports 00000020:00000080:3.0:1789127124.026934:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebba4 00000020:00000080:3.0:1789127124.026939:0:21459:0:(genops.c:885:class_export_put()) final put ffff994238d0f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789127124.026954:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff99422cca8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1789127124.027337:0:21459:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789127124.027342:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789127124.027353:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1789127124.027359:0:21459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789127124.027361:0:21459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789127124.027597:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789127124.027741:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127124.027749:0:21459:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789127124.027754:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb96 00000020:00000080:3.0:1789127124.027758:0:21459:0:(genops.c:885:class_export_put()) final put ffff994104282000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127124.027785:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99422043b000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789127124.027791:0:470:0:(genops.c:885:class_export_put()) final put ffff994104286800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127124.027793:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994104286800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789127124.027797:0:470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789127124.028012:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789127124.028017:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127124.028022:0:21459:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789127124.028026:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff99422d561a48) has no exports 00000020:00000080:3.0:1789127124.028031:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb8f 00000020:00000080:3.0:1789127124.028036:0:21459:0:(genops.c:885:class_export_put()) final put ffff9941032b4000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789127124.028060:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994104282000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1789127124.028485:0:21459:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789127124.028489:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789127124.028491:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1789127124.028496:0:21459:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789127124.028498:0:21459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789127124.035258:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9941032b4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789127124.035596:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127124.035610:0:21459:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789127124.035626:0:21459:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789127124.035635:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb81 00000020:00000080:3.0:1789127124.035645:0:21459:0:(genops.c:885:class_export_put()) final put ffff994238d0b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127124.037908:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941032b3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789127124.037925:0:470:0:(genops.c:885:class_export_put()) final put ffff994238d0d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127124.037929:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789127124.037937:0:470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789127124.038026:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789127124.038081:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789127124.038089:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127124.038098:0:21459:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789127124.038102:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff99422d563490) has no exports 00000020:00000080:3.0:1789127124.038110:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb7a 00000020:00000080:3.0:1789127124.038117:0:21459:0:(genops.c:885:class_export_put()) final put ffff994104281800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789127124.038267:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994104281800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789127124.040734:0:21459:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789127124.040743:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789127124.040747:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789127124.040755:0:21459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127124.040968:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994104282800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789127124.041106:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127124.041119:0:21459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789127124.041125:0:21459:0:(genops.c:885:class_export_put()) final put ffff994104284000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127124.041129:0:21459:0:(genops.c:844:class_export_destroy()) destroying export ffff994104284000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789127124.041142:0:21459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789127124.041568:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127124.041574:0:21459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789127124.041587:0:21459:0:(genops.c:885:class_export_put()) final put ffff99422d545000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127124.041590:0:21459:0:(genops.c:844:class_export_destroy()) destroying export ffff99422d545000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789127124.041596:0:21459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789127124.041676:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb50 00000020:00000080:2.0:1789127124.041692:0:21459:0:(genops.c:885:class_export_put()) final put ffff99422ccae000/lustre-MDD0000_UUID 00000020:01000000:2.0:1789127124.041702:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789127124.041707:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127124.041712:0:21459:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789127124.041716:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff99422d560000) has no exports 00000020:00000080:2.0:1789127124.041737:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127124.041741:0:21459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789127124.041745:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebb57 00000020:00000080:2.0:1789127124.041749:0:21459:0:(genops.c:885:class_export_put()) final put ffff99422ccab800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789127124.041757:0:21459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9941050e6800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789127124.041760:0:21459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9941050e6800 3 00000020:01000004:2.0:1789127124.041763:0:21459:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9941050e6800 from lustre-MDT0000 00000020:00000080:2.0:1789127124.041783:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127124.041786:0:21459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789127124.041788:0:21459:0:(genops.c:885:class_export_put()) final put ffff994238d0c000/lustre-MDT0000_UUID 00000020:00000080:2.0:1789127124.041790:0:21459:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d0c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789127124.041798:0:21459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1789127124.041938:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccae000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789127124.041944:0:470:0:(genops.c:885:class_export_put()) final put ffff994238d08000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789127124.041946:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff994238d08000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789127124.041954:0:470:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789127124.042001:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1789127124.046277:0:21459:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1789127124.046288:0:21459:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789127124.046294:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789127124.046299:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127124.046304:0:21459:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789127124.046323:0:21459:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff99421226f800 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127124.046331:0:21459:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9942366bced8) has exports, disconnecting them 00000020:00080000:2.0:1789127124.046338:0:21459:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99421226f800), last request at 1789127029 00000020:00000080:2.0:1789127124.046370:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebafc 00000020:00010000:2.0:1789127124.046376:0:21459:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99421226f800: total 0 00000100:00080000:2.0:1789127124.046391:0:21459:0:(import.c:65:import_set_state_nolock()) ffff99421226e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789127124.046426:0:21459:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99421226f800): rc 0 00000020:00080000:2.0:1789127124.046432:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9942366bced8) has no exports 00000020:00010000:0.0:1789127124.046469:0:20291:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99421226f800: total 0 00000100:00100000:2.0:1789127124.046496:0:17870:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff994236751400:17870] 0 exiting: rc = 1 00010000:00010000:0.0:1789127124.046519:0:20291:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99421226f800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789127124.046554:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104396800/0xa840b4da666ec0c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ec0ba expref: 14 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046572:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994212167000/0xa840b4da666ebe21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebe1a expref: 13 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046587:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994212166800/0xa840b4da666ebd5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebd56 expref: 12 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046596:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994212166c00/0xa840b4da666ebc1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebc14 expref: 11 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046625:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589800/0xa840b4da666ebff6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebfef expref: 10 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046637:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994212167800/0xa840b4da666ebd87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebd80 expref: 9 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046663:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cac00/0xa840b4da666ec0b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ec0ac expref: 8 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046676:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994212167200/0xa840b4da666ebcd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebcd1 expref: 7 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046695:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67000/0xa840b4da666ebc29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebc22 expref: 6 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046710:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994212166200/0xa840b4da666ebc37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebc30 expref: 5 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046719:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994104b67800/0xa840b4da666ebb0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebb03 expref: 4 pid: 17871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046728:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994212166400/0xa840b4da666ebdf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ebdf0 expref: 3 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046740:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb800/0xa840b4da666ec0a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa840b4da666ec09e expref: 2 pid: 17872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127124.046750:0:20291:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99421226f800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789127124.046765:0:20291:0:(genops.c:885:class_export_put()) final put ffff99421226f800/079828d5-aec4-4859-8d9f-8f5f0b6e8ad0 00010000:00010000:0.0:1789127124.046780:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127124.046788:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127124.046790:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789127124.047265:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff99421226f800/079828d5-aec4-4859-8d9f-8f5f0b6e8ad0 for MGS 00000020:00000080:2.0:1789127124.047292:0:470:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99421226e800 for MGS 00000100:00100000:0.0:1789127124.047511:0:17871:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff994236750200:17871] 1 exiting: rc = 0 00000100:00100000:1.0:1789127124.048232:0:17872:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff994236750600:17872] 2 exiting: rc = 0 00000100:00100000:2.0:1789127124.048322:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048333:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048339:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048352:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048358:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048391:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048397:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048402:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048407:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048413:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048421:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048427:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048432:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048438:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048445:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048450:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048454:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048465:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048471:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048476:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048484:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048492:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048498:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048506:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048513:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048518:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048523:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048529:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048550:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048558:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048567:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048571:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048576:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048581:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048585:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048590:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048594:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048599:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048604:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048608:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048612:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048617:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048621:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048626:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048631:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048636:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048641:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048670:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048678:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048695:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048701:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048707:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048714:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048722:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048732:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048740:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048744:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048749:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048754:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048759:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048764:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048769:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048775:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127124.048789:0:21459:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789127124.050874:0:21459:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994102c14780 - data ffff994231685870/ffff99423cef2400 00000020:01000000:0.0:1789127124.051050:0:21459:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994204f6f840 - data ffff9942317000d8/ffff99423d1a0c00 00000020:00000080:0.0:1789127124.051818:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebae0 00000020:00000080:0.0:1789127124.051828:0:21459:0:(genops.c:885:class_export_put()) final put ffff994212269000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789127124.051847:0:21459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9941050e6800 from MGS, refs=2 00000020:01000004:0.0:1789127124.051852:0:21459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9941050e6800 2 00000020:01000004:0.0:1789127124.051856:0:21459:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9941050e6800 from MGS 00000020:00000080:0.0:1789127124.051879:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127124.051885:0:21459:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789127124.051888:0:21459:0:(genops.c:885:class_export_put()) final put ffff99421226f000/MGS 00000020:00000080:0.0:1789127124.051891:0:21459:0:(genops.c:844:class_export_destroy()) destroying export ffff99421226f000/MGS for MGS 00000020:01000000:0.0:1789127124.051898:0:21459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1789127124.051910:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994212269000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789127124.051960:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789127124.051964:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127124.051969:0:21459:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789127124.051976:0:21459:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff994210e06800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789127124.051981:0:21459:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff99423d001a48) has exports, disconnecting them 00000020:00080000:0.0:1789127124.051986:0:21459:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff994210e06800), last request at 1789127030 00000020:00000080:0.0:1789127124.051990:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebbe3 00000020:00080000:0.0:1789127124.052001:0:21459:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994210e06800): rc 0 00000020:00000080:0.0:1789127124.052006:0:21459:0:(genops.c:885:class_export_put()) final put ffff994210e06800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789127124.052127:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994210e06800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789127124.074749:0:21459:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789127124.074763:0:21459:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127124.074767:0:21459:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789127124.074775:0:21459:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789127124.074818:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994210e00800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789127124.074965:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127124.074973:0:21459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789127124.074980:0:21459:0:(genops.c:885:class_export_put()) final put ffff994210e03800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789127124.074983:0:21459:0:(genops.c:844:class_export_destroy()) destroying export ffff994210e03800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789127124.074992:0:21459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789127124.075065:0:21459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9941050e6800 1 00000020:00000080:2.0:1789127124.075071:0:21459:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebad2 00000020:00000080:2.0:1789127124.075076:0:21459:0:(genops.c:885:class_export_put()) final put ffff99421226b000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789127124.075090:0:21459:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789127124.075094:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127124.075098:0:21459:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789127124.075101:0:21459:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff994103ecced8) has no exports 00000020:00000080:3.0:1789127124.075389:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99421226b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789127124.145565:0:21459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127124.145578:0:21459:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789127124.145583:0:21459:0:(genops.c:885:class_export_put()) final put ffff9941050e2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789127124.145587:0:21459:0:(genops.c:844:class_export_destroy()) destroying export ffff9941050e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789127124.145597:0:21459:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789127124.147432:0:21459:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9941050e1800 00000020:02000400:0.0:1789127124.147493:0:21459:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789127125.035392:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127126.059049:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127126.315368:0:18631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789127127.084485:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127127.211935:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276861056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127127.212018:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127127.212154:0:19389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276861056 00000100:00100000:3.0:1789127127.212162:0:19389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276861056 00000100:00100000:3.0:1789127127.212232:0:19389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789127127.212243:0:19389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276861056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127127.212274:0:19389:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789127127.212322:0:19389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276861056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127127.212329:0:19389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789127127.212417:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276861056:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789127127.212472:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1789127127.615579:0:21661:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789127127.637912:0:21661:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789127127.637982:0:21661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.638008:0:21661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.638016:0:21661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.638023:0:21661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.638061:0:21661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789127127.638068:0:21661:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789127127.638106:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127127.638112:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789127127.638119:0:21661:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789127127.638124:0:21661:0:(import.c:65:import_set_state_nolock()) ffff9942405e9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789127127.638131:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127127.638133:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789127127.638136:0:21661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789127127.639414:0:21661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639428:0:21661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639436:0:21661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639443:0:21661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639466:0:21661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789127127.639472:0:21661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639478:0:21661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639502:0:21661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639508:0:21661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639522:0:21661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789127127.639528:0:21661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639534:0:21661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639541:0:21661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639546:0:21661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639554:0:21661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789127127.639558:0:21661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639564:0:21661:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.639570:0:21661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.640092:0:21661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127127.640101:0:21661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:2.0:1789127127.640105:0:21661:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789127127.640139:0:21661:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789127127.640144:0:21661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789127127.640148:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127127.640153:0:21661:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789127127.640160:0:21661:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9941049ba000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127127.640166:0:21661:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff994207565000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127127.640172:0:21661:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff994238d48000) has exports, disconnecting them 00000020:00080000:2.0:1789127127.640176:0:21661:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9941049ba000), last request at 1789127123 00000020:00000080:2.0:1789127127.640186:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebe4b 00000100:00080000:2.0:1789127127.640206:0:21661:0:(import.c:65:import_set_state_nolock()) ffff9941049be000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789127127.640315:0:21661:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9941049ba000): rc 0 00000020:00000080:2.0:1789127127.640318:0:21661:0:(genops.c:885:class_export_put()) final put ffff9941049ba000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789127127.640332:0:21661:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff994207565000), last request at 1789127123 00000020:00000080:2.0:1789127127.640336:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebdb1 00000100:00080000:2.0:1789127127.640342:0:21661:0:(import.c:65:import_set_state_nolock()) ffff994207563800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789127127.640347:0:21661:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994207565000): rc 0 00000020:00000080:2.0:1789127127.640349:0:21661:0:(genops.c:885:class_export_put()) final put ffff994207565000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789127127.640354:0:21661:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb30541c93ae0 00000100:00080000:2.0:1789127127.640376:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127127.640379:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789127127.641498:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789127127.641510:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641521:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127127.641526:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641537:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127127.641545:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127127.641551:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127127.641553:0:17866:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789127127.641556:0:17866:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789127127.641613:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641788:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127127.641823:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641830:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994212167a00/0xa840b4da666ebcd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebcd8 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641842:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789127127.641846:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641851:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127127.641854:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641861:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127127.641867:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127127.641871:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127127.641873:0:17866:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1789127127.641875:0:17866:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1789127127.641889:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641895:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127127.641900:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641915:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2600/0xa840b4da666ebc30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebc37 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641925:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789127127.641929:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641935:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127127.641938:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641946:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127127.641952:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127127.641956:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127127.641958:0:17866:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789127127.641960:0:17866:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789127127.641972:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.641977:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127127.642130:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642138:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104b66200/0xa840b4da666ebfef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebff6 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642164:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127127.642167:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642173:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397e00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127127.642176:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642182:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127127.642187:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127127.642192:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789127127.642194:0:17866:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789127127.642196:0:17866:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789127127.642209:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642214:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127127.642220:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642225:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104397e00/0xa840b4da666ec0ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ec0c1 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642234:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127127.642237:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642247:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127127.642250:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642256:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127127.642262:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127127.642266:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127127.642268:0:17866:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789127127.642269:0:17866:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789127127.642278:0:17866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642282:0:17866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127127.642286:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642292:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2800/0xa840b4da666ebc22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa840b4da666ebc29 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127127.642301:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127127.642303:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127127.642304:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127127.642313:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127127.642319:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127127.642335:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276861312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127127.642418:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127127.642469:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789127127.642475:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276861184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127127.642497:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127127.642512:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276861696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127127.642530:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127127.642559:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276861312 00000100:00100000:3.0:1789127127.642566:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276861312 00000100:00080000:2.0:1789127127.643260:0:21661:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789127127.643268:0:21661:0:(import.c:65:import_set_state_nolock()) ffff99423d03f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:2.0:1789127127.643337:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276861184 00000100:00100000:2.0:1789127127.643343:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276861184 00000100:00100000:3.0:1789127127.643413:0:17862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276861696 00000100:00100000:3.0:1789127127.643417:0:17862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276861696 00000100:00100000:2.0:1789127127.643458:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127127.643465:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1876035276861312:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789127127.643471:0:17863:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127127 with bad export cookie 12123889046995778300 00000100:00100000:0.0:1789127127.643807:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276861568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127127.643857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127127.643912:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127127.643919:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276861440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127127.643943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789127127.643963:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9941049ba000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789127127.644027:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994207565000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789127127.644049:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941049be000 for lustre-MDT0001 00000020:00000080:0.0:1789127127.644054:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994207563800 for lustre-MDT0001 00000100:00100000:0.0:1789127127.644067:0:17864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276861568 00000100:00100000:0.0:1789127127.644071:0:17864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276861568 00000100:00100000:0.0:1789127127.644085:0:17864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276861440 00000100:00100000:0.0:1789127127.644087:0:17864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276861440 00000100:00100000:0.0:1789127127.644096:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127127.644101:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1876035276861184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789127127.644106:0:17864:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127127 with bad export cookie 12123889046995778300 00000100:00100000:0.0:1789127127.644161:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3642:x1876035276861184:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1663us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789127127.644168:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127127.644185:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127127.644188:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1876035276861568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789127127.644192:0:17864:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127127 with bad export cookie 12123889046995778300 00000100:00100000:0.0:1789127127.644219:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1876035276861568:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (361us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789127127.644235:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127127.644247:0:17864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127127.644251:0:17864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423d1a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1876035276861440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789127127.644255:0:17864:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127127 with bad export cookie 12123889046995778300 00000100:00100000:0.0:1789127127.644281:0:17864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423d1a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1876035276861440:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (337us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789127127.644286:0:17864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789127127.644389:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789127127.644393:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9941050e4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789127127.644397:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1789127127.649567:0:17862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127127.649579:0:17862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1876035276861696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789127127.649596:0:17862:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127127 with bad export cookie 12123889046995778300 00000100:00100000:3.0:1789127127.649843:0:17862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1876035276861696:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (7310us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789127127.649851:0:17862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789127127.650044:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789127127.650048:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789127127.650061:0:21661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789127127.650131:0:21661:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789127127.650155:0:21661:0:(import.c:65:import_set_state_nolock()) ffff99423d063800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789127127.650175:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789127127.650178:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789127127.650189:0:21661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789127127.650248:0:21661:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789127127.650257:0:21661:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789127127.650297:0:21661:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff994238d48000) has no exports 00000100:00100000:3.0:1789127127.650329:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276861824:0@lo:9:umount.0 00000100:00100000:3.0:1789127127.650385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127127.650411:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276861952:0@lo:9:umount.0 00000100:00100000:3.0:1789127127.650431:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127127.650465:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276861824 00000100:00100000:3.0:1789127127.650472:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276861824 00000100:00100000:3.0:1789127127.650507:0:19387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276861952 00000100:00100000:3.0:1789127127.650510:0:19387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276861952 00000100:00100000:3.0:1789127127.650534:0:19387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127127.650541:0:19387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876035276861824:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789127127.650563:0:19387:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebddb 00000100:00080000:3.0:1789127127.650572:0:19387:0:(import.c:65:import_set_state_nolock()) ffff994207562800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127127.650621:0:19387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:1.0:1789127127.650958:0:17873:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127127.650973:0:19386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789127127.650982:0:19386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876035276861952:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789127127.651336:0:19387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3638:x1876035276861824:12345-0@lo:9:umount.0 Request processed in 794us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127127.651343:0:19387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1789127127.651369:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127127.651396:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d063800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789127127.651406:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789127127.651408:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789127127.651411:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276861824:0@lo:9:umount.0 00000020:00000080:1.0:1789127127.651568:0:19386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebe67 00000100:00080000:1.0:1789127127.651577:0:19386:0:(import.c:65:import_set_state_nolock()) ffff994102c7a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789127127.651721:0:19386:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789127127.651952:0:19386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3638:x1876035276861952:12345-0@lo:9:umount.0 Request processed in 970us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127127.651958:0:19386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789127127.651994:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d039000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789127127.651998:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789127127.651999:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789127127.652001:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276861952:0@lo:9:umount.0 00010000:00010000:3.0:1789127127.652062:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127127.652855:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1789127127.655419:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3642:x1876035276861312:12345-0@lo:103:ldlm_bl.0 Request processed in 11948us (12998us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789127127.655433:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789127127.674227:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.123@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789127127.674232:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789127127.674243:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422051c780 x1876035276861312/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127143 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127127.674258:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422051f840 x1876035276861184/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127143 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127127.674266:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422051cf00 x1876035276861696/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127143 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127127.674274:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422051c3c0 x1876035276861568/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127143 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127127.674284:0:3642:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422051fc00 x1876035276861440/t0(0) o103->MGC192.168.203.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127143 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789127127.674872:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789127127.674877:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789127127.674879:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789127127.674976:0:3640:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9941050e4800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1789127127.675005:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276861568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127127.675032:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3640:1876035276861440:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789127127.675067:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9941050e4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127127.675073:0:3642:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 455 00000100:00080000:0.0:1789127127.675096:0:3642:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff9941050e4800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127127.675126:0:3642:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994105018f00 x1876035276862080/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127127.675173:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3638:1876035276862080:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1789127127.675217:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876035276862080 offset 0 length 520: 4 00000100:00100000:0.0:1789127127.675276:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276861696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127127.675283:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276861312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127127.675296:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3642:1876035276861184:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789127127.681124:0:21661:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff994238d48000) has no exports 00000020:01000000:3.0:1789127127.751283:0:21661:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994102c146c0 - data ffff9942088adca8/ffff99423cef1800 00000020:01000000:3.0:1789127127.751437:0:21661:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9941040550c0 - data ffff9942314721b0/ffff994205e45400 00000001:00000004:3.0:1789127127.764090:0:21661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1789127127.806006:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127127.806019:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789127127.806029:0:21661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789127127.808172:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789127127.808182:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789127127.808203:0:21661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789127127.808205:0:21661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789127127.808562:0:18621:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789127127.808569:0:18621:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1789127127.808642:0:18621:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789127127.809947:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789127127.809954:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789127127.809964:0:21661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789127127.809967:0:21661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789127127.810158:0:18623:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789127127.810163:0:18623:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789127127.810172:0:18623:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789127127.812118:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc45 00000020:00000080:2.0:1789127127.812134:0:21661:0:(genops.c:885:class_export_put()) final put ffff99422ccaa800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789127127.812196:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccaa800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789127127.813993:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc5a 00000020:00000080:2.0:1789127127.814012:0:21661:0:(genops.c:885:class_export_put()) final put ffff99423d03e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789127127.814035:0:21661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789127127.814043:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127127.814055:0:21661:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1789127127.814059:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d03e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00080000:2.0:1789127127.814060:0:21661:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff994238d49a48) has no exports 00000004:01000000:2.0:1789127127.815038:0:21661:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789127127.815055:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebcae 00000020:00000080:2.0:1789127127.815068:0:21661:0:(genops.c:885:class_export_put()) final put ffff9942364b8800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789127127.815092:0:21661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789127127.815103:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127127.815115:0:21661:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00000080:0.0:1789127127.815116:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942364b8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00080000:2.0:1789127127.815137:0:21661:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9942290f4ed8) has no exports 00000020:00000080:2.0:1789127127.815148:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebca7 00000020:00000080:2.0:1789127127.815155:0:21661:0:(genops.c:885:class_export_put()) final put ffff99423d03a000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789127127.815206:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d03a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789127127.817306:0:21661:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789127127.817314:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789127127.817318:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789127127.817325:0:21661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789127127.817327:0:21661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789127127.817379:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127127.817389:0:21661:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789127127.817398:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc99 00000020:00000080:2.0:1789127127.817405:0:21661:0:(genops.c:885:class_export_put()) final put ffff99422f9ef800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789127127.817412:0:21661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789127127.817418:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127127.817422:0:21661:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789127127.817426:0:21661:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff99423d004ed8) has no exports 00000020:00000080:2.0:1789127127.817431:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc92 00000020:00000080:2.0:1789127127.817434:0:21661:0:(genops.c:885:class_export_put()) final put ffff99423d065800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789127127.817717:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99423d039000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789127127.817733:0:8:0:(genops.c:885:class_export_put()) final put ffff99422f9ed000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789127127.817739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99422f9ed000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789127127.817747:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127127.817860:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99422f9ef800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789127127.817867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d065800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789127127.818060:0:21661:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789127127.818065:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789127127.818067:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789127127.818071:0:21661:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789127127.818073:0:21661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789127127.818115:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127127.818120:0:21661:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789127127.818136:0:21661:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789127127.818142:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc7d 00000020:00000080:2.0:1789127127.818149:0:21661:0:(genops.c:885:class_export_put()) final put ffff99423d038000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789127127.818153:0:21661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789127127.818158:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127127.818161:0:21661:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789127127.818164:0:21661:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9942290f0000) has no exports 00000020:00000080:2.0:1789127127.818179:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc76 00000020:00000080:2.0:1789127127.818182:0:21661:0:(genops.c:885:class_export_put()) final put ffff99423d03b800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789127127.819372:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99423d063800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789127127.819386:0:8:0:(genops.c:885:class_export_put()) final put ffff994202f1f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789127127.819389:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994202f1f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789127127.819397:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127127.820106:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d038000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789127127.820114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d03b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789127127.824856:0:21661:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789127127.824877:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127127.824881:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789127127.824890:0:21661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127127.824952:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127127.824964:0:21661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127127.824988:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127127.824991:0:21661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127127.824997:0:21661:0:(genops.c:885:class_export_put()) final put ffff9941048a9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789127127.825001:0:21661:0:(genops.c:844:class_export_destroy()) destroying export ffff9941048a9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789127127.825013:0:21661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127127.825158:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc61 00000020:00000080:0.0:1789127127.825164:0:21661:0:(genops.c:885:class_export_put()) final put ffff99423d03b000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789127127.825169:0:21661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789127127.825172:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127127.825176:0:21661:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789127127.825180:0:21661:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff994238d4ced8) has no exports 00000020:00000080:0.0:1789127127.825199:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127127.825202:0:21661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789127127.825206:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc68 00000020:00000080:0.0:1789127127.825210:0:21661:0:(genops.c:885:class_export_put()) final put ffff99423d03d000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789127127.825217:0:21661:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99422035d800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789127127.825220:0:21661:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99422035d800 2 00000020:01000004:0.0:1789127127.825223:0:21661:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99422035d800 from lustre-MDT0001 00000020:00000080:0.0:1789127127.825242:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127127.825244:0:21661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789127127.825247:0:21661:0:(genops.c:885:class_export_put()) final put ffff99422ccaa000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789127127.825249:0:21661:0:(genops.c:844:class_export_destroy()) destroying export ffff99422ccaa000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789127127.825255:0:21661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789127127.825289:0:21661:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789127127.825292:0:21661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789127127.825303:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127127.825306:0:21661:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789127127.825312:0:21661:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff994205df8800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789127127.825318:0:21661:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff994102eb9a48) has exports, disconnecting them 00000020:00080000:0.0:1789127127.825322:0:21661:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff994205df8800), last request at 1789127044 00000020:00000080:0.0:1789127127.825326:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebce6 00000020:00080000:0.0:1789127127.825337:0:21661:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994205df8800): rc 0 00000020:00000080:0.0:1789127127.825341:0:21661:0:(genops.c:885:class_export_put()) final put ffff994205df8800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789127127.825501:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99423d03f000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789127127.825508:0:8:0:(genops.c:885:class_export_put()) final put ffff99423d03c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789127127.825510:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d03c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789127127.825515:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789127127.825587:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d03b000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789127127.825590:0:8:0:(genops.c:885:class_export_put()) final put ffff99423d039800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789127127.825592:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d039800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789127127.825595:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789127127.825717:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d03d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789127127.825722:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994205df8800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789127127.849276:0:21661:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789127127.849285:0:21661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127127.849289:0:21661:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789127127.849297:0:21661:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127127.849577:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127127.849586:0:21661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789127127.849592:0:21661:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99422035d800 1 00000020:00000080:0.0:1789127127.849599:0:21661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebc0d 00000020:00000080:0.0:1789127127.849608:0:21661:0:(genops.c:885:class_export_put()) final put ffff994210e05800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789127127.849823:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942405e9800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789127127.849831:0:8:0:(genops.c:885:class_export_put()) final put ffff9942405ee800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789127127.849834:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942405ee800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789127127.849846:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:0.0:1789127127.849993:0:21661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789127127.849998:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127127.850003:0:21661:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789127127.850006:0:21661:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9942366bb490) has no exports 00000020:00000080:1.0:1789127127.852351:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994210e05800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789127127.951122:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127127.951140:0:21661:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789127127.951146:0:21661:0:(genops.c:885:class_export_put()) final put ffff994202f19800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789127127.951161:0:21661:0:(genops.c:844:class_export_destroy()) destroying export ffff994202f19800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789127127.951173:0:21661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789127127.951294:0:21661:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99422035d000 00000020:01000000:1.0:1789127127.951317:0:21661:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789127127.951322:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127127.951326:0:21661:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789127127.951330:0:21661:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff994102ebb490) has no exports 00000100:00100000:0.0:1789127127.952124:0:17876:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff994203ed7c00:17876] 1 exiting: rc = 0 00000100:00100000:3.0:1789127127.952279:0:17877:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff994102664a00:17877] 2 exiting: rc = 0 00000100:00100000:3.0:1789127127.952408:0:20680:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9941050ab800:20680] 4 exiting: rc = 0 00000100:00100000:3.0:1789127127.952520:0:19940:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff994205dc3200:19940] 3 exiting: rc = 0 00000100:00100000:3.0:1789127127.952598:0:17875:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff994211056000:17875] 0 exiting: rc = 1 00000100:00100000:1.0:1789127127.953990:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954002:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954008:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954015:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954021:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954028:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954034:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954039:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954045:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954050:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954057:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954064:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954070:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954075:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954080:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954085:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954090:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954095:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954102:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954107:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954113:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954119:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954124:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954130:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954135:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954140:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954146:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954171:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954176:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954182:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954188:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954194:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954199:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954204:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954210:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954215:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954221:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954227:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954233:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954238:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954243:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954249:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954255:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954260:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954266:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954272:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954278:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954283:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954289:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954295:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954300:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954306:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954312:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954318:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954323:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954328:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954334:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954340:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954346:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954351:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954356:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954361:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954376:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.954382:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.962225:0:17880:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99423d00ac00:17880] 1 exiting: rc = 0 00000100:00100000:2.0:1789127127.963447:0:17879:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99423d00ba00:17879] 0 exiting: rc = 1 00000100:00100000:0.0:1789127127.964765:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964778:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964786:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964791:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964796:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964801:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964805:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964811:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964828:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964832:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964837:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964842:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964847:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964852:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964857:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964863:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964867:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964872:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964878:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964883:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964888:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964893:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964898:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964904:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964909:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964913:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964918:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964924:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964929:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964934:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964939:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964945:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964950:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964955:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964959:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964964:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964969:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964974:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964980:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964985:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964990:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964994:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.964999:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965011:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965016:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965020:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965025:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965030:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965036:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965041:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965046:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965051:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965056:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965062:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965067:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965072:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965077:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965082:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965087:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965092:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965096:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965100:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965105:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965111:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.965560:0:17881:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99410326ae00:17881] 0 exiting: rc = 1 00000100:00100000:0.0:1789127127.965679:0:17882:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99410326ac00:17882] 1 exiting: rc = 0 00000100:00100000:2.0:1789127127.966101:0:21460:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff994206461800:21460] 2 exiting: rc = 0 00000100:00100000:0.0:1789127127.967153:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967165:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967171:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967177:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967183:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967189:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967195:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967200:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967205:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967228:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967235:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967240:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967256:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967265:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967271:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967277:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967282:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967288:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967293:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967299:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967307:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967770:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967785:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967792:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967799:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967806:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967814:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967821:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967827:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967833:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967839:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967845:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967852:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967874:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967881:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967888:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967894:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967901:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967908:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967914:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967921:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967930:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967938:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967944:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967951:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967971:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967978:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967992:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.967999:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968005:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968011:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968018:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968024:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968031:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968037:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968043:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968049:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968067:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968074:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968080:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968087:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968093:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968101:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127127.968114:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127127.979944:0:17884:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99423d009c00:17884] 1 exiting: rc = 0 00000100:00100000:2.0:1789127127.980162:0:17883:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99410326aa00:17883] 0 exiting: rc = 1 00000100:00100000:1.0:1789127127.980251:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980259:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980265:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980270:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980276:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980281:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980286:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980292:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980298:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980303:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980308:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980313:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980319:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980324:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980329:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980334:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980338:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980344:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980349:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980356:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980361:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980365:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980370:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980375:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980380:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980385:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980390:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980395:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980399:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980405:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980410:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980426:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980431:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980452:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980458:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980463:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980468:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980472:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980477:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980482:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980486:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980492:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980497:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980502:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980506:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980511:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980515:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980519:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980524:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980528:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980532:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980537:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980541:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980546:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980552:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980557:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980572:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980578:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980583:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980588:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980593:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980598:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980602:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.980608:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127127.981070:0:17886:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff994229097000:17886] 1 exiting: rc = 0 00000100:00100000:2.0:1789127127.981188:0:17885:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff994103d28400:17885] 0 exiting: rc = 1 00000100:00100000:1.0:1789127127.981443:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981450:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981455:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981461:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981476:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981480:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981486:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981490:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981495:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981499:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981504:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981509:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981514:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981519:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981524:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981529:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981534:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981539:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981544:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981548:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981553:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981557:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981572:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981578:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981582:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981587:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981592:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981596:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981601:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981605:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981610:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981615:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981620:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981624:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981630:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981635:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981640:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981644:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981684:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.981696:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982217:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982228:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982233:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982237:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982241:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982246:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982252:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982257:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982262:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982267:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982272:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982277:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982281:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982287:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982292:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982297:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982301:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982307:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982312:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982317:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982322:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982327:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982342:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.982347:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127127.983279:0:17887:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff994229096c00:17887] 0 exiting: rc = 1 00000100:00100000:2.0:1789127127.983506:0:17888:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff994229097a00:17888] 1 exiting: rc = 0 00000100:00100000:1.0:1789127127.984229:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984237:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984242:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984247:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984252:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984258:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984262:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984267:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984271:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984276:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984297:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984302:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984307:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984312:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984317:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.984322:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985165:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985180:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985186:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985191:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985197:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985201:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985206:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985211:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985217:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985223:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985229:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985237:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985243:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985249:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985386:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985394:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985399:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985404:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985409:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985415:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985419:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985424:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985429:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985434:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985439:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985444:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985449:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985453:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985458:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985472:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985477:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985482:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985486:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985492:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985497:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985502:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985508:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985513:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985517:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985521:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985526:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985531:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985536:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985540:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985545:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985550:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.985555:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.986321:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127127.988503:0:17889:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff99422d6b5a00:17889] 0 exiting: rc = 1 00000100:00100000:0.0:1789127127.989059:0:17891:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99422d6b4000:17891] 2 exiting: rc = 0 00000100:00100000:3.0:1789127127.990718:0:17890:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff99422d6b4e00:17890] 1 exiting: rc = 0 00000100:00100000:1.0:1789127127.990912:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990921:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990927:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990933:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990939:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990946:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990951:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990957:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990962:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990968:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990974:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990980:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990986:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990992:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.990997:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991003:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991019:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991026:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991032:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991038:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991044:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991050:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991056:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991062:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991080:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991087:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991093:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991099:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991104:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991110:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991117:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991122:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991128:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991133:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991139:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991145:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991151:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991157:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991163:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991169:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991175:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991181:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991187:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991192:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991198:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991204:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991209:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991216:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991233:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991241:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991246:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991257:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991262:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991269:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991274:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991280:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991286:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991292:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991298:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991304:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991310:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991316:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991321:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127127.991339:0:21661:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789127127.997298:0:21661:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127127.997311:0:21661:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789127127.997317:0:21661:0:(genops.c:885:class_export_put()) final put ffff99422fade000/MDS_uuid 00000020:00000080:0.0:1789127127.997322:0:21661:0:(genops.c:844:class_export_destroy()) destroying export ffff99422fade000/MDS_uuid for MDS 00000020:01000000:0.0:1789127127.997327:0:21661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789127127.997765:0:21661:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789127128.106825:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789127128.235733:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789127128.235743:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127128.235746:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789127128.235750:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789127128.235753:0:8:0:(import.c:65:import_set_state_nolock()) ffff9941030ce800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127128.235762:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 548 00000100:00080000:2.0:1789127128.235767:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789127128.235775:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9941030ce800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127128.235814:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104061680 x1876035276862208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127128.235864:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789127128.235868:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789127128.235870:0:8:0:(import.c:65:import_set_state_nolock()) ffff994102c7e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127128.235874:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 548 00000100:00080000:2.0:1789127128.235877:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789127128.235880:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994102c7e800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127128.235891:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104061a40 x1876035276862464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127128.235975:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276862208:0@lo:38:kworker.0 00000100:00100000:3.0:1789127128.235992:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276862592:0@lo:400:kworker.0 00000400:00000100:2.0:1789127128.236030:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276862208 offset 0 length 520: 4 00000400:00000100:3.0:1789127128.236035:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276862592 offset 0 length 224: 4 00000100:00100000:2.0:1789127128.236070:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276862464:0@lo:38:kworker.0 00000400:00000100:2.0:1789127128.236093:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276862464 offset 0 length 520: 4 00000100:00100000:2.0:1789127128.236125:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276862336:0@lo:400:kworker.0 00000400:00000100:2.0:1789127128.236143:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276862336 offset 0 length 224: 4 00010000:00010000:3.0:1789127129.135352:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127130.154831:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127131.178755:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789127131.663565:0:21862:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789127131.683392:0:21862:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789127131.683486:0:21862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127131.683504:0:21862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127131.683513:0:21862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127131.683521:0:21862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127131.683550:0:21862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789127131.683557:0:21862:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789127131.683586:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1789127131.683589:0:21862:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1789127131.683596:0:17866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127131.683606:0:21862:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994104061680 x1876035276862208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789127131.683608:0:17866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127131.683613:0:17866:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127131.683710:0:21862:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789127131.683718:0:21862:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789127131.683727:0:21862:0:(import.c:65:import_set_state_nolock()) ffff9941030ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789127131.683734:0:21862:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127131.683740:0:21862:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994104061680 x1876035276862208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127148 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127131.683750:0:21862:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789127131.683757:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276862208:0@lo:38:kworker.0 00010000:00010000:0.0:1789127131.683863:0:17866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127131.683869:0:17866:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127131.683874:0:17866:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789127131.683876:0:17866:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789127131.683878:0:17866:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789127131.683892:0:17866:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9941050e4800 00010000:00010000:0.0:1789127131.683895:0:17866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127131.683900:0:17866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104397a00/0xa840b4da666ebd80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebd87 expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127131.683912:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127131.683913:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127131.683915:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127131.683981:0:21862:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789127131.687024:0:21862:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789127131.687046:0:21862:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994104062d00 x1876035276862336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127144 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127131.687075:0:21862:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789127131.687081:0:21862:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789127131.687113:0:21862:0:(import.c:65:import_set_state_nolock()) ffff994102f33000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789127131.687392:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276862336:0@lo:400:kworker.0 00000100:00100000:1.0:1789127131.688006:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276862720:0@lo:39:umount.0 00000400:00000100:1.0:1789127131.688071:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276862720 offset 0 length 224: 4 00010000:00010000:1.0:1789127132.203339:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127132.266807:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127132.266820:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127132.266824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127132.266827:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127132.266962:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127132.266989:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276862848:0@lo:400:kworker.0 00000400:00000100:3.0:1789127132.267058:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276862848 offset 0 length 224: 4 00010000:00010000:0.0:1789127133.226885:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127133.290817:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127133.290832:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127133.290860:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127133.290864:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789127133.291101:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127133.291126:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276862976:0@lo:400:kworker.0 00000400:00000100:1.0:1789127133.291201:0:3642:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276862976 offset 0 length 224: 4 00000001:00100000:2.0:1789127133.869311:0:20203:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789127133.869319:0:20203:0:(genops.c:885:class_export_put()) final put ffff994102c7e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789127133.869694:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994102c7e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789127133.869733:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102c7a000 for lustre-OST0001 00000001:00100000:3.0:1789127133.870000:0:19382:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789127133.870004:0:19382:0:(genops.c:885:class_export_put()) final put ffff994207567800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789127133.870156:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994207567800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789127133.870270:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994207562800 for lustre-OST0000 00010000:00010000:0.0:1789127134.250801:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127135.275193:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127136.299239:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127137.322798:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127137.834847:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127127/real 1789127127] req@ffff994105018f00 x1876035276862080/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789127137 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127137.834879:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994105018f00 x1876035276862080/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789127137 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127137.834897:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941050e4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127137.834938:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789127137.834942:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3638:1876035276862080:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1789127137.835943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789127137.835950:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789127137.835953:0:8:0:(import.c:65:import_set_state_nolock()) ffff9941050e4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127137.835958:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 552 00000100:00080000:3.0:1789127137.835964:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.123@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789127137.835971:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff9941050e4800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127137.836009:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422051f0c0 x1876035276863104/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127137.836039:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789127137.836044:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789127137.836158:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3638:1876035276863104:0@lo:250:kworker.0 00000400:00000100:1.0:1789127137.836203:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876035276863104 offset 0 length 520: 4 00000100:00100000:0.0:1789127137.836300:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127137.836310:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276863232:0@lo:400:kworker.0 00000400:00000100:0.0:1789127137.836334:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276863232 offset 0 length 224: 4 00010000:00010000:3.0:1789127138.346910:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127139.370834:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127140.394841:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127141.421115:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127141.931318:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127131/real 1789127131] req@ffff99422051e580 x1876035276862720/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127141 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127141.931352:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99422051e580 x1876035276862720/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127141 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127141.931384:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102f33000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789127141.931404:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276862720:0@lo:39:umount.0 00000100:00080000:3.0:1789127141.931679:0:21862:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789127141.931684:0:21862:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789127141.931689:0:21862:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789127141.933766:0:21862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127141.933784:0:21862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127141.933792:0:21862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127141.933799:0:21862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127141.933822:0:21862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127141.933829:0:21862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127141.933835:0:21862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127141.933841:0:21862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127141.933862:0:21862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127141.933886:0:21862:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789127141.933891:0:21862:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789127141.933914:0:21862:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789127141.933918:0:21862:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789127141.933923:0:21862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127141.933928:0:21862:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789127141.933933:0:21862:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9942290f3490) has no exports 00000020:00080000:3.0:1789127141.934047:0:21862:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9942290f3490) has no exports 00010000:00010000:0.0:1789127141.934969:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127141.934980:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127141.934989:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396000 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127141.934994:0:20291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127141.935004:0:20291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127141.935013:0:20291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127141.935018:0:20291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789127141.935021:0:20291:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789127141.935036:0:20291:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789127141.935052:0:20291:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9941050e4800 00010000:00010000:0.0:1789127141.935056:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127141.935064:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104396000/0xa840b4da666ebd56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebd5d expref: -99 pid: 19381 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127141.935078:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127141.935083:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127141.935088:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127141.935092:0:20291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127141.935099:0:20291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127141.935105:0:20291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127141.935111:0:20291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789127141.935113:0:20291:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789127141.935115:0:20291:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789127141.935121:0:20291:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9941050e4800 00010000:00010000:0.0:1789127141.935124:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127141.935131:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104b66a00/0xa840b4da666ec0ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ec0b3 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127141.935153:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127141.935154:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127141.935156:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127141.935604:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789127141.939042:0:21862:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9941042e7c60 - data ffff9942315c7e58/ffff9941010fd400 00000020:01000000:3.0:1789127141.939163:0:21862:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994103018cc0 - data ffff9941028f7360/ffff9941041f8000 00100000:10000000:3.0:1789127141.951596:0:21862:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789127141.961370:0:21862:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebd6b 00000020:00000080:2.0:1789127141.961382:0:21862:0:(genops.c:885:class_export_put()) final put ffff994104835000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789127141.961404:0:21862:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9942064a1800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789127141.961408:0:21862:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9942064a1800 2 00000020:01000004:2.0:1789127141.961410:0:21862:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9942064a1800 from lustre-OST0000 00000020:00000080:2.0:1789127141.961437:0:21862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127141.961447:0:21862:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789127141.961449:0:21862:0:(genops.c:885:class_export_put()) final put ffff994104834000/lustre-OST0000_UUID 00000020:00000080:2.0:1789127141.961453:0:21862:0:(genops.c:844:class_export_destroy()) destroying export ffff994104834000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789127141.961459:0:21862:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789127141.961510:0:21862:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789127141.961515:0:21862:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789127141.961518:0:21862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127141.961523:0:21862:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789127141.961530:0:21862:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9941030c9800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127141.961536:0:21862:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff99423d000000) has exports, disconnecting them 00000020:00080000:2.0:1789127141.961550:0:21862:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9941030c9800), last request at 1789127061 00000020:00000080:2.0:1789127141.961554:0:21862:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebd95 00000020:00080000:2.0:1789127141.961575:0:21862:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9941030c9800): rc 0 00000020:00000080:2.0:1789127141.961579:0:21862:0:(genops.c:885:class_export_put()) final put ffff9941030c9800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789127141.961776:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994104835000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789127141.961788:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9941030c9800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789127141.978713:0:21862:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789127141.978721:0:21862:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127141.978726:0:21862:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789127141.978732:0:21862:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789127141.978902:0:21862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127141.978910:0:21862:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789127141.978917:0:21862:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789127141.978924:0:21862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127141.978928:0:21862:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789127141.978935:0:21862:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9941030cb000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127141.978941:0:21862:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9941032d9a48) has exports, disconnecting them 00000020:00080000:2.0:1789127141.978946:0:21862:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9941030cb000), last request at 1789127061 00000020:00000080:2.0:1789127141.978950:0:21862:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebdaa 00000020:00080000:2.0:1789127141.978965:0:21862:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9941030cb000): rc 0 00000020:00000080:2.0:1789127141.978969:0:21862:0:(genops.c:885:class_export_put()) final put ffff9941030cb000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789127141.979020:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941030ce800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789127141.979029:0:8:0:(genops.c:885:class_export_put()) final put ffff9941030ca800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789127141.979032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9941030ca800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789127141.979041:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789127141.979124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9941030cb000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789127141.995830:0:21862:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789127141.995840:0:21862:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789127141.995844:0:21862:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789127141.995850:0:21862:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789127141.995893:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102f33000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789127141.996189:0:21862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127141.996198:0:21862:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1789127141.996203:0:21862:0:(genops.c:885:class_export_put()) final put ffff9941030cd000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1789127141.996206:0:21862:0:(genops.c:844:class_export_destroy()) destroying export ffff9941030cd000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1789127141.996213:0:21862:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789127141.996943:0:21862:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9942064a1800 1 00000020:00000080:2.0:1789127141.996961:0:21862:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebd48 00000020:00000080:2.0:1789127141.996968:0:21862:0:(genops.c:885:class_export_put()) final put ffff994205dfd000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789127141.997017:0:21862:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789127141.997022:0:21862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127141.997028:0:21862:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789127141.997032:0:21862:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff99423d003490) has no exports 00000020:00000080:1.0:1789127142.009246:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994205dfd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789127142.050074:0:21862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127142.050213:0:21862:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789127142.050220:0:21862:0:(genops.c:885:class_export_put()) final put ffff9942064a7800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789127142.050225:0:21862:0:(genops.c:844:class_export_destroy()) destroying export ffff9942064a7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789127142.050236:0:21862:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789127142.050360:0:21862:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9942064a4000 00000020:02000400:1.0:1789127142.050406:0:21862:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789127142.450880:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127143.082855:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127143.082865:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127143.082869:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127143.082872:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127143.082954:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276863360:0@lo:400:kworker.0 00000400:00000100:3.0:1789127143.083005:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276863360 offset 0 length 224: 4 00010000:00010000:1.0:1789127143.468643:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1789127144.106874:0:3639:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127128/real 1789127128] req@ffff994104063480 x1876035276862592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127144.136160:0:3639:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff994104063480 x1876035276862592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127144.136174:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9941049bf800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789127144.136178:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789127144.155114:0:3639:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1789127144.155161:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789127144.155178:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127144.155181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789127144.155185:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127144.155187:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789127144.155189:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789127144.155194:0:37:0:(import.c:65:import_set_state_nolock()) ffff9941049bf800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127144.155203:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1789127144.155213:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9941049bf800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127144.155250:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422051f840 x1876035276863488/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127144.155355:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276863488:0@lo:38:kworker.0 00000400:00000100:3.0:1789127144.155416:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035276863488 offset 0 length 520: 4 00000100:00100000:0.0:1789127144.155613:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276862592:0@lo:400:kworker.0 00010000:00010000:1.0:1789127144.491277:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789127145.276229:0:22064:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789127145.284214:0:22064:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789127145.284296:0:22064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.284312:0:22064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.284320:0:22064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.284328:0:22064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.284380:0:22064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789127145.284386:0:22064:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789127145.284412:0:22064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127145.284422:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994104061a40 x1876035276862464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127145.284456:0:22064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789127145.284462:0:22064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789127145.284469:0:22064:0:(import.c:65:import_set_state_nolock()) ffff994102c7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789127145.284473:0:22064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127145.284478:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994104061a40 x1876035276862464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127148 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127145.284486:0:22064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789127145.284491:0:22064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:3.0:1789127145.284526:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789127145.284527:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276862464:0@lo:38:kworker.0 00010000:00010000:3.0:1789127145.284534:0:17865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789127145.285628:0:22064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789127145.285639:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9941050183c0 x1876035276862848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789127145.286004:0:17865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127145.286009:0:17865:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127145.286021:0:17865:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127145.286029:0:17865:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127145.286051:0:17865:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127145.286055:0:17865:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789127145.286057:0:17865:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789127145.286073:0:17865:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9941050e4800 00010000:00010000:3.0:1789127145.286077:0:17865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127145.286084:0:17865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994212166a00/0xa840b4da666ebe1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebe21 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127145.286096:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127145.286098:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127145.286100:0:17865:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127145.286132:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99410501a940 x1876035276862976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127149 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127145.286154:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422051ed00 x1876035276863232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127145.286170:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99410501a1c0 x1876035276863360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127159 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127145.286179:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422051f840 x1876035276863488/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127154 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127145.286191:0:22064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789127145.286219:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276863232:0@lo:400:kworker.0 00000100:00080000:0.0:1789127145.286248:0:22064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789127145.286253:0:22064:0:(import.c:65:import_set_state_nolock()) ffff9941049bf800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789127145.286258:0:22064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789127145.286262:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9941050183c0 x1876035276862848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127148 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127145.286407:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1876035276862976:0@lo:400:kworker.0 00000100:00100000:1.0:1789127145.286455:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276862848:0@lo:400:kworker.0 00000100:00100000:0.0:1789127145.286474:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99410501a940 x1876035276862976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127149 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127145.286483:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99410501a1c0 x1876035276863360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127159 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127145.286492:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422051f840 x1876035276863488/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127154 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127145.286499:0:22064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789127145.286587:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276863360:0@lo:400:kworker.0 00000100:00100000:1.0:1789127145.286609:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276863488:0@lo:38:kworker.0 00000100:00100000:0.0:1789127145.286641:0:22064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789127145.288153:0:22064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.288169:0:22064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.288178:0:22064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.288185:0:22064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.288242:0:22064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127145.288250:0:22064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.288258:0:22064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.288265:0:22064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127145.288282:0:22064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127145.288310:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127145.288318:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127145.288326:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789127145.288330:0:20291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127145.288339:0:20291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127145.288347:0:20291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127145.288353:0:20291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789127145.288356:0:20291:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789127145.288365:0:20291:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9941050e4800 00010000:00010000:1.0:1789127145.288369:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127145.288387:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104397600/0xa840b4da666ebdf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebdf7 expref: -99 pid: 20202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127145.288400:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127145.288403:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127145.288409:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104b66e00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789127145.288413:0:20291:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127145.288420:0:20291:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127145.288427:0:20291:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127145.288433:0:20291:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789127145.288435:0:20291:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789127145.288439:0:20291:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9941050e4800 00010000:00010000:1.0:1789127145.288442:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127145.288448:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127145.288450:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127145.288452:0:20291:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127145.288506:0:22064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789127145.288511:0:22064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104b66e00/0xa840b4da666ec09e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ec0a5 expref: -99 pid: 17874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127145.288526:0:22064:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789127145.288530:0:22064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789127145.288533:0:22064:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789127145.288566:0:22064:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789127145.288571:0:22064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789127145.288576:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127145.288581:0:22064:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789127145.288586:0:22064:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9941032db490) has no exports 00000020:00080000:0.0:1789127145.288727:0:22064:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9941032db490) has no exports 00000020:01000000:0.0:1789127145.290705:0:22064:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994104055780 - data ffff9942316b4360/ffff99423ceb7400 00000020:01000000:0.0:1789127145.290865:0:22064:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff994202a71480 - data ffff99423148aa20/ffff99423cef9c00 00010000:00010000:1.0:1789127145.291529:0:17866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789127145.303428:0:22064:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789127145.310371:0:22064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebe05 00000020:00000080:3.0:1789127145.310382:0:22064:0:(genops.c:885:class_export_put()) final put ffff994102cc5000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789127145.310468:0:22064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994207565800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789127145.310473:0:22064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994207565800 2 00000020:01000004:3.0:1789127145.310476:0:22064:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff994207565800 from lustre-OST0001 00000020:00000080:3.0:1789127145.310499:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127145.310506:0:22064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789127145.310510:0:22064:0:(genops.c:885:class_export_put()) final put ffff994102cc0800/lustre-OST0001_UUID 00000020:00000080:3.0:1789127145.310513:0:22064:0:(genops.c:844:class_export_destroy()) destroying export ffff994102cc0800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789127145.310520:0:22064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789127145.310633:0:22064:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0->MGS 00010000:00010000:3.0:1789127145.310683:0:22064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebc1b expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127145.310695:0:22064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebc1b expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127145.310709:0:22064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789127145.310712:0:22064:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789127145.310715:0:22064:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789127145.310731:0:22064:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9941050e4800 00010000:00010000:3.0:1789127145.310734:0:22064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2c00/0xa840b4da666ebc14 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebc1b expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127145.310751:0:22064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127145.310758:0:22064:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127145.310763:0:22064:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789127145.310765:0:22064:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789127145.310767:0:22064:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789127145.310778:0:22064:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9941050e4800 00010000:00010000:3.0:1789127145.310780:0:22064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994104396a00/0xa840b4da666ebb03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa840b4da666ebb0a expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789127145.310805:0:22064:0:(import.c:65:import_set_state_nolock()) ffff9941050e4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789127145.310809:0:22064:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789127145.310812:0:22064:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789127145.310814:0:22064:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789127145.310819:0:22064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789127145.310830:0:22064:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99422051f0c0 x1876035276863104/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789127152 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789127145.310847:0:22064:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789127145.310850:0:22064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1789127145.314098:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994102cc5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1789127145.314166:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:079828d5-aec4-4859-8d9f-8f5f0b6e8ad0:3638:1876035276863104:0@lo:250:kworker.0 10000000:01000000:3.0:1789127145.314314:0:22064:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789127145.314337:0:22064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebaee 00000020:00000080:3.0:1789127145.314346:0:22064:0:(genops.c:885:class_export_put()) final put ffff99422fadd000/079828d5-aec4-4859-8d9f-8f5f0b6e8ad0 00000020:01000000:3.0:1789127145.314366:0:22064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.123@tcp (flags='') 00000020:00000080:3.0:1789127145.314373:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127145.314379:0:22064:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.123@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789127145.314384:0:22064:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff994103ec8000) has no exports 00000020:00000080:1.0:1789127145.314993:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99422fadd000/079828d5-aec4-4859-8d9f-8f5f0b6e8ad0 for MGC192.168.203.123@tcp 10000000:01000000:0.0:1789127145.315081:0:17874:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789127145.315218:0:22064:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.123@tcp: client import never connected 00000100:00080000:1.0:1789127145.315222:0:22064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789127145.315226:0:22064:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789127145.315229:0:22064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789127145.315232:0:22064:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789127145.315285:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127145.315291:0:22064:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.123@tcp (uuid 079828d5-aec4-4859-8d9f-8f5f0b6e8ad0) 00000020:01000000:1.0:1789127145.315299:0:22064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789127145.315303:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127145.315308:0:22064:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789127145.315313:0:22064:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff994102c79800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789127145.315318:0:22064:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9942290f1a48) has exports, disconnecting them 00000020:00080000:1.0:1789127145.315323:0:22064:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff994102c79800), last request at 1789127075 00000020:00000080:1.0:1789127145.315327:0:22064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebe2f 00000020:00080000:1.0:1789127145.315342:0:22064:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff994102c79800): rc 0 00000020:00000080:1.0:1789127145.315345:0:22064:0:(genops.c:885:class_export_put()) final put ffff994102c79800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789127145.315636:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941050e4800 for MGC192.168.203.123@tcp 00000020:00000080:3.0:1789127145.315644:0:37:0:(genops.c:885:class_export_put()) final put ffff9941050e5800/079828d5-aec4-4859-8d9f-8f5f0b6e8ad0 00000020:00000080:3.0:1789127145.315679:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941050e5800/079828d5-aec4-4859-8d9f-8f5f0b6e8ad0 for MGC192.168.203.123@tcp 00010000:01000000:0.0:1789127145.316874:0:22064:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789127145.316880:0:22064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127145.316884:0:22064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789127145.316891:0:22064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127145.317051:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127145.317058:0:22064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789127145.317064:0:22064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789127145.317068:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127145.317073:0:22064:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789127145.317078:0:22064:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9941049bd800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789127145.317093:0:22064:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff994105088000) has exports, disconnecting them 00000020:00080000:0.0:1789127145.317097:0:22064:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9941049bd800), last request at 1789127075 00000020:00000080:0.0:1789127145.317101:0:22064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebe44 00000020:00080000:0.0:1789127145.317112:0:22064:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9941049bd800): rc 0 00000020:00000080:0.0:1789127145.317116:0:22064:0:(genops.c:885:class_export_put()) final put ffff9941049bd800/lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789127145.318206:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.123@tcp (079828d5-aec4-4859-8d9f-8f5f0b6e8ad0) 00000020:00000080:3.0:1789127145.318517:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994102c79800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789127145.318526:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994102c7e800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789127145.318531:0:37:0:(genops.c:885:class_export_put()) final put ffff994102c79000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789127145.318533:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994102c79000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789127145.318548:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789127145.318580:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9941049bd800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789127145.335254:0:22064:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789127145.335261:0:22064:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789127145.335265:0:22064:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789127145.335271:0:22064:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789127145.335343:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9941049bf800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789127145.335359:0:17865:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789127145.335572:0:20291:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789127145.335817:0:17866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789127145.335985:0:17861:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99421235d600:17861] 1 exiting: rc = 0 00000100:00100000:1.0:1789127145.335985:0:17860:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99421235cc00:17860] 0 exiting: rc = 1 00000100:00100000:0.0:1789127145.336125:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.336370:0:17864:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99422cc8f400:17864] 2 exiting: rc = 0 00000100:00100000:3.0:1789127145.336372:0:17862:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99421235c200:17862] 0 exiting: rc = 1 00000100:00100000:3.0:1789127145.336430:0:17863:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99422cc8ee00:17863] 1 exiting: rc = 0 00000100:00100000:1.0:1789127145.336430:0:20223:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff994104a94200:20223] 3 exiting: rc = 0 00000100:00100000:0.0:1789127145.336528:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336535:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336551:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336557:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336564:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336569:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336576:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336581:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336586:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336591:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336597:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336602:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336607:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336613:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336620:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336625:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336630:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336635:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336640:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336644:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336769:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336776:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336794:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336799:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336804:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336810:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336814:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336819:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336824:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336829:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336833:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336838:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336843:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336847:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336852:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336857:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336861:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336866:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336870:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336875:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336880:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336885:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336890:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336894:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336899:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336905:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336911:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336917:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336922:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336927:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336932:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336938:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336942:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336947:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336952:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336958:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336962:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336975:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336980:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336985:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336991:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.336996:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.337001:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.337006:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789127145.337769:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127145.337779:0:22064:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789127145.337784:0:22064:0:(genops.c:885:class_export_put()) final put ffff9941049bf000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789127145.337789:0:22064:0:(genops.c:844:class_export_destroy()) destroying export ffff9941049bf000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789127145.337799:0:22064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789127145.337845:0:22064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994207565800 1 00000020:00000080:0.0:1789127145.337850:0:22064:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa840b4da666ebde9 00000020:00000080:0.0:1789127145.337856:0:22064:0:(genops.c:885:class_export_put()) final put ffff9942064b0800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789127145.337905:0:22064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789127145.337910:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127145.337915:0:22064:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789127145.337919:0:22064:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9942366b9a48) has no exports 00000020:00000080:3.0:1789127145.342775:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942064b0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789127145.374723:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127145.374736:0:22064:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789127145.374742:0:22064:0:(genops.c:885:class_export_put()) final put ffff99423d066800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789127145.374747:0:22064:0:(genops.c:844:class_export_destroy()) destroying export ffff99423d066800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789127145.374758:0:22064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789127145.375075:0:22064:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9942064a2800 00000020:01000000:0.0:1789127145.375100:0:22064:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789127145.375104:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127145.375108:0:22064:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789127145.375112:0:22064:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9942366b8000) has no exports 00000020:00000080:0.0:1789127145.375132:0:22064:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127145.375136:0:22064:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789127145.375139:0:22064:0:(genops.c:885:class_export_put()) final put ffff994205dfb000/OSS_uuid 00000020:00000080:0.0:1789127145.375141:0:22064:0:(genops.c:844:class_export_destroy()) destroying export ffff994205dfb000/OSS_uuid for OSS 00000020:01000000:0.0:1789127145.375155:0:22064:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789127145.375323:0:19941:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff994205dc3600:19941] 3 exiting: rc = 0 00000100:00100000:3.0:1789127145.375325:0:19387:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9941026b7800:19387] 1 exiting: rc = 0 00000100:00100000:1.0:1789127145.375452:0:19386:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff994104848200:19386] 0 exiting: rc = 1 00000100:00100000:3.0:1789127145.375512:0:19388:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff994104081000:19388] 2 exiting: rc = 0 00000100:00080000:2.0:1789127145.375568:0:17873:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789127145.375701:0:20286:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9941050abe00:20286] 4 exiting: rc = 0 00000100:00100000:0.0:1789127145.375803:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375811:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375817:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375822:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375827:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375832:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375836:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375841:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375846:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375852:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375857:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375863:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375868:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375874:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375884:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375890:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375895:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375900:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375905:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375910:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375915:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375924:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375929:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375968:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375974:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375985:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375993:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.375999:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376030:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376035:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376040:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376045:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376050:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376064:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376069:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376074:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376079:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376085:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376090:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376095:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376100:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376104:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376109:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376114:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376118:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376123:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376128:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376133:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376138:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376144:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376149:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376155:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376160:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376165:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376169:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376174:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376179:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376184:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376188:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376193:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376198:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376203:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376208:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.376214:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127145.377160:0:19389:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff994104848800:19389] 0 exiting: rc = 1 00000100:00100000:1.0:1789127145.377241:0:19390:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff994211056c00:19390] 1 exiting: rc = 0 00000100:00100000:2.0:1789127145.377314:0:20797:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9942066d3800:20797] 2 exiting: rc = 0 00000100:00100000:0.0:1789127145.377422:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377429:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377435:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377440:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377457:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377463:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377469:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377474:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377480:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377485:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377491:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377496:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377502:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377507:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377514:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377520:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377525:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377531:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377548:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377554:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377559:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377565:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377570:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377576:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377581:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377587:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377592:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377598:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377603:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377608:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377614:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377620:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377625:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377630:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377636:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377640:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377645:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377886:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377891:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377904:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377909:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377914:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377920:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377925:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377930:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377935:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377942:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377946:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377952:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377957:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377962:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377968:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377973:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377978:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377983:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377988:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377994:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.377998:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.378003:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.378007:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.378012:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.378017:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.378023:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.378028:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.379364:0:19392:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff994102d01c00:19392] 1 exiting: rc = 0 00000100:00100000:3.0:1789127145.379727:0:19393:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff994104849800:19393] 2 exiting: rc = 0 00000100:00100000:2.0:1789127145.380054:0:19391:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff994102d01800:19391] 0 exiting: rc = 1 00000100:00100000:0.0:1789127145.380157:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380164:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380171:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380184:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380200:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380207:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380213:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380219:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380224:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380244:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380250:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380256:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380263:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380268:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380273:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380278:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380284:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380289:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380295:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380301:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380306:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380312:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380318:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380323:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380328:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380333:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380339:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380344:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380364:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380372:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380378:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380384:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380390:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380397:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380404:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380409:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380417:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380423:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380430:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380438:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380444:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380450:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380457:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380463:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380478:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380486:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380492:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380497:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380504:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380509:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380515:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380521:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380553:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380560:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380565:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380570:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380575:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380581:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380587:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380593:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380598:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380613:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380621:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.380634:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127145.384573:0:19394:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9942080e3200:19394] 0 exiting: rc = 1 00000100:00100000:0.0:1789127145.385031:0:19395:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff994205ed5000:19395] 1 exiting: rc = 0 00000100:00100000:1.0:1789127145.385132:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385140:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385146:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385196:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385203:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385209:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385230:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385241:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385249:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385253:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385259:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385264:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385269:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385274:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385279:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385285:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385289:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385294:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385299:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385304:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385308:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385313:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385318:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385324:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385329:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385334:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385339:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385344:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385348:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385353:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385359:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385363:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385368:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385373:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385378:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385383:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385388:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385393:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385398:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385405:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385410:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385423:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385428:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385434:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385439:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385444:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385449:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385454:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385459:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385464:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385470:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385475:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385481:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385485:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385490:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385495:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385500:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385505:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385511:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385516:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385521:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385526:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385531:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.385546:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127145.387043:0:19396:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99421384f800:19396] 0 exiting: rc = 1 00000100:00100000:3.0:1789127145.387487:0:19397:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99421384fc00:19397] 1 exiting: rc = 0 00000100:00100000:0.0:1789127145.387566:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387589:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387613:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387621:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387627:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387632:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387637:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387643:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387734:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387741:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387747:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387752:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387757:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387763:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387788:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387794:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387799:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387805:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387811:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387816:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387821:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387827:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387833:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387838:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387844:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387850:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387870:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387876:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387882:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387888:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387893:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387899:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387904:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387911:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387918:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387923:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387929:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387935:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387955:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387962:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387968:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387973:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387977:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387981:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387985:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387991:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.387997:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388002:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388007:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388020:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388038:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388045:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388050:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388056:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388070:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388077:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388082:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388088:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388093:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388099:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388105:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388111:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388117:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127145.388130:0:22064:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789127145.400346:0:22064:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789127161.833512:0:22827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789127170.109921:0:23426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789127170.109928:0:23426:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789127170.109930:0:23426:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789127170.110078:0:23426:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff994103e26000 00000020:01000004:1.0:1789127170.110095:0:23426:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789127170.110329:0:23426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789127170.110345:0:23426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff994102eb9a48) 00000020:00000080:1.0:1789127170.110359:0:23426:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789127170.177040:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789127170.184350:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789127170.187911:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789127170.194416:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789127170.194748:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789127170.194960:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789127170.195159:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789127170.195749:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789127170.195957:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789127170.196122:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789127170.196304:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789127170.196534:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789127170.196941:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789127170.197197:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789127170.197391:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789127170.198046:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.198345:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.198548:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.198802:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.198979:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.199198:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.199417:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.199638:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.199868:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.200043:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.200252:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.200434:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.200695:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.200904:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.201076:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.201253:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.201478:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.201699:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.201913:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.202115:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.202277:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.202691:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.202917:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.203096:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.203301:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.203531:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.203740:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.203946:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.204153:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.204363:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.204587:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789127170.204860:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789127170.205250:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789127170.205674:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789127170.205841:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789127170.206238:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1789127170.206450:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789127170.206674:0:23426:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1789127170.207340:0:23426:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789127170.207551:0:23426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789127170.207558:0:23426:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789127170.207569:0:23426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ec361 00000020:01000004:2.0:1789127170.207575:0:23426:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789127170.207580:0:23426:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789127170.207585:0:23426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994103e26000 from MGS 00000020:01000004:2.0:1789127170.207588:0:23426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789127170.207598:0:23426:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff994105089a48) 00000020:00000080:2.0:1789127170.207607:0:23426:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789127170.207730:0:23426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994103e26000 from MGS, refs=2 00080000:01000000:2.0:1789127170.207735:0:23426:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789127170.207741:0:23426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ec36f 00000100:00100000:2.0:1789127170.207834:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789127170.207956:0:23426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789127170.207962:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789127170.208586:0:23426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789127170.208593:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789127170.209305:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127170.209461:0:23426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789127170.209466:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789127170.209946:0:23426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789127170.209953:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789127170.210260:0:23426:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789127170.210266:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789127170.211119:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127170.211123:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127170.211131:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127170.211359:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127170.211362:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127170.211364:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127170.211938:0:23426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789127170.213774:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789127170.215895:0:23426:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789127170.216636:0:23438:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789127170.216743:0:23426:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789127170.216773:0:23426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789127170.217588:0:23426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789127170.217954:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127170.218096:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789127170.218102:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789127170.220056:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789127170.220067:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789127170.224268:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789127170.224282:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1789127170.225014:0:23443:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1789127170.225244:0:23426:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789127170.225264:0:23426:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.123@tcp' 00000020:01000004:3.0:1789127170.225266:0:23426:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789127170.225294:0:23426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.123@tcp (typ=mgc) 00000020:00000080:3.0:1789127170.225306:0:23426:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.123@tcp (ffff9942290f1a48) 00000020:00000080:3.0:1789127170.225320:0:23426:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789127170.225410:0:23426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99422fa9f800@MGC192.168.203.123@tcp: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789127170.225707:0:23426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.123@tcp-0 is initialized 00000040:01000000:3.0:1789127170.225713:0:23426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789127170.226819:0:23444:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789127170.228591:0:23426:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.123@tcp (uuid c8bdd08e-30e7-43f1-a5d6-15b6369dde73) 00000020:00000080:3.0:1789127170.228616:0:23426:0:(genops.c:1385:class_connect()) connect: client c8bdd08e-30e7-43f1-a5d6-15b6369dde73, cookie 0xa840b4da666ec37d 00000100:00080000:3.0:1789127170.228628:0:23426:0:(import.c:510:import_select_connection()) MGC192.168.203.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127170.228635:0:23426:0:(import.c:624:import_select_connection()) MGC192.168.203.123@tcp: import ffff99422fa9f800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127170.228682:0:23426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422051fc00 x1876035276863616/t0(0) o250->MGC192.168.203.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127170.228770:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3638:1876035276863616:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789127170.228833:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127170.228897:0:23426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c8bdd08e-30e7-43f1-a5d6-15b6369dde73->MGS 00000020:01000004:3.0:1789127170.228919:0:23426:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789127170.228924:0:23426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789127170.228938:0:23426:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9942290f3490) 00000020:00000080:3.0:1789127170.228959:0:23426:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789127170.229703:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276863616 00000100:00100000:0.0:1789127170.229712:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276863616 00000100:00100000:0.0:1789127170.229752:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127170.229760:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1876035276863616:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789127170.229783:0:23439:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from c8bdd08e-30e7-43f1-a5d6-15b6369dde73@0@lo t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:0.0:1789127170.229831:0:23439:0:(genops.c:1385:class_connect()) connect: client c8bdd08e-30e7-43f1-a5d6-15b6369dde73, cookie 0xa840b4da666ec38b 00000100:00080000:0.0:1789127170.230017:0:23439:0:(import.c:65:import_set_state_nolock()) ffff994102f34800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127170.232588:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+5:3638:x1876035276863616:12345-0@lo:250:mount.lustre.0 Request processed in 2818us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127170.232602:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127170.235732:0:3638:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789127170.235748:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.123@tcp: connect to target with instance 0 00000100:00080000:1.0:1789127170.235756:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789127170.235761:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789127170.235766:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422fa9f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789127170.235770:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789127170.235792:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789127170.236162:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3638:1876035276863616:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789127170.240072:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127170.240275:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789127170.240282:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789127170.242810:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789127170.242822:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789127170.243151:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789127170.243158:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789127170.243852:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127170.244029:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789127170.244035:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789127170.245999:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789127170.246009:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789127170.281219:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127170.281433:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789127170.281440:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789127170.282565:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789127170.283025:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789127170.283519:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127170.283723:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789127170.283729:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789127170.284278:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127170.284284:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789127170.284856:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127170.285010:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789127170.285016:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789127170.285376:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127170.285382:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789127170.286298:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127170.286453:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789127170.286458:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789127170.287348:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789127170.287358:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789127170.305624:0:23426:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127170.305866:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789127170.305880:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789127170.308589:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789127170.308602:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789127170.310444:0:23426:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789127170.310456:0:23426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789127170.312104:0:23426:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789127170.312133:0:23426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789127170.312138:0:23426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789127170.312240:0:23426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789127170.312277:0:23426:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789127170.312282:0:23426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789127170.312283:0:23426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789127170.312284:0:23426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127170.312285:0:23426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127170.312286:0:23426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127170.312287:0:23426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127170.312289:0:23426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127170.312291:0:23426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789127170.312293:0:23426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127170.312294:0:23426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127170.312297:0:23426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789127170.312299:0:23426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127170.312300:0:23426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789127170.312301:0:23426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127170.312302:0:23426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127170.312302:0:23426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127170.312303:0:23426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127170.312304:0:23426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127170.312305:0:23426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789127170.312306:0:23426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127170.312307:0:23426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127170.312332:0:23426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789127170.312353:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276863744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789127170.313714:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.313768:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127170.313854:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276863744 00000100:00100000:1.0:1789127170.313861:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276863744 00000100:00100000:1.0:1789127170.313941:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127170.313952:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+5:23426:x1876035276863744:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789127170.314004:0:23442:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789127170.314007:0:23442:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789127170.314010:0:23442:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789127170.315551:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789127170.318850:0:23442:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1789127170.321559:0:23464:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789127170.321566:0:23464:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789127170.321570:0:23464:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789127170.321580:0:23464:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789127170.321751:0:23464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789127170.322004:0:23442:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789127170.322014:0:23442:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789127170.323880:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+5:23426:x1876035276863744:12345-0@lo:253:mount.lustre.0 Request processed in 9923us (10163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127170.323898:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127170.324011:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276863744:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127170.324025:0:23426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789127170.324028:0:23426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127170.324030:0:23426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789127170.324031:0:23426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127170.324032:0:23426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127170.324034:0:23426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127170.324035:0:23426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127170.324036:0:23426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127170.324038:0:23426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789127170.324040:0:23426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127170.324042:0:23426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789127170.324059:0:23426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff994103e26000 from lustre-MDT0000 10000000:01000000:0.0:1789127170.324087:0:23426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789127170.324090:0:23426:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789127170.324094:0:23426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9942290f1a48 10000000:01000000:0.0:1789127170.324098:0:23426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127170.324105:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9942290f1a48 from 1 10000000:01000000:0.0:1789127170.324108:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789127170.324142:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.324154:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.324163:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127170.324182:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276863872:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127170.324229:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.324268:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff99420513bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.324330:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276863872 00000100:00100000:2.0:1789127170.324337:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276863872 00000100:00100000:2.0:1789127170.324385:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127170.324394:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+5:23426:x1876035276863872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127170.324406:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127170.324423:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588000/0xa840b4da666ec399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec392 expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.324444:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588000/0xa840b4da666ec399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec392 expref: 6 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.324452:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588000/0xa840b4da666ec399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec392 expref: 6 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.324472:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588000, rc 0) 00000100:00100000:2.0:1789127170.324512:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+6:23426:x1876035276863872:12345-0@lo:101:mount.lustre.0 Request processed in 119us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127170.324519:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127170.324611:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276863872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127170.324623:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.324632:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127170.324713:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127170.324740:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127170.324765:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127170.324874:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276864000 00000100:00100000:3.0:1789127170.324878:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276864000 00000100:00100000:3.0:1789127170.324911:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127170.324918:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+6:23426:x1876035276864000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127170.325072:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+6:23426:x1876035276864000:12345-0@lo:501:mount.lustre.0 Request processed in 154us (330us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789127170.325079:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127170.325735:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864000:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789127170.325763:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789127170.325826:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.325834:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127170.325842:0:23426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff994103e26000 10000000:01000000:1.0:1789127170.325847:0:23426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789127170.325851:0:23426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff994103e26000 10000000:01000000:1.0:1789127170.325853:0:23426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789127170.325855:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff994103e26000 from 1 10000000:01000000:1.0:1789127170.325857:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789127170.325878:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148e000/0xa840b4da666ec3a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.325898:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420148e000/0xa840b4da666ec3a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.325905:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420148e000/0xa840b4da666ec3a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127170.325920:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127170.325948:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127170.325981:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127170.328578:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276864128 00000100:00100000:0.0:1789127170.328591:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276864128 00000100:00100000:0.0:1789127170.328757:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127170.328768:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+6:23426:x1876035276864128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127170.328783:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127170.328802:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb000/0xa840b4da666ec3a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec3a0 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.328833:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb000/0xa840b4da666ec3a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec3a0 expref: 7 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.328843:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb000/0xa840b4da666ec3a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec3a0 expref: 7 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.328852:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb000, rc 0) 00000100:00100000:0.0:1789127170.328920:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+7:23426:x1876035276864128:12345-0@lo:101:mount.lustre.0 Request processed in 154us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127170.328927:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127170.328940:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127170.328956:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420148e000/0xa840b4da666ec3a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec3a7 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.328970:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420148e000/0xa840b4da666ec3a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec3a7 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127170.328999:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789127170.329012:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148e000/0xa840b4da666ec3a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec3a7 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.329563:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420148e000/0xa840b4da666ec3a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec3a7 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127170.329575:0:23426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789127170.329581:0:23426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127170.329587:0:23426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff994103e26000 10000000:01000000:1.0:1789127170.329589:0:23426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789127170.329600:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789127170.329602:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789127170.329626:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ec3ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.329634:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ec3ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.329643:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ec3ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127170.329694:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864256:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127170.329734:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127170.329881:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127170.330166:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276864256 00000100:00100000:3.0:1789127170.330171:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276864256 00000100:00100000:3.0:1789127170.330288:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127170.330298:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+7:23426:x1876035276864256:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127170.330307:0:23442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127170.330328:0:23442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ec3b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec3ae expref: -99 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127170.330347:0:23442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ec3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec3ae expref: 8 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127170.330356:0:23442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2c00/0xa840b4da666ec3b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec3ae expref: 8 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127170.330373:0:23442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2c00, rc 0) 00000100:00100000:3.0:1789127170.330450:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+8:23426:x1876035276864256:12345-0@lo:101:mount.lustre.0 Request processed in 153us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127170.330457:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127170.330572:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864256:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127170.330645:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ec3ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec3b5 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.330680:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ec3ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec3b5 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127170.330738:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127170.330765:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127170.330793:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127170.330877:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276864384 00000100:00100000:0.0:1789127170.330881:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276864384 00000100:00100000:0.0:1789127170.330953:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127170.330961:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+8:23426:x1876035276864384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127170.331097:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+9:23426:x1876035276864384:12345-0@lo:501:mount.lustre.0 Request processed in 137us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127170.331105:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127170.331162:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864384:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127170.331189:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127170.331229:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127170.331339:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.331425:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276864512 00000100:00100000:2.0:1789127170.331430:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276864512 00000100:00100000:2.0:1789127170.331452:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127170.331459:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+9:23426:x1876035276864512:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127170.332379:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+9:23426:x1876035276864512:12345-0@lo:503:mount.lustre.0 Request processed in 905us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127170.332388:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127170.332519:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276864512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127170.333196:0:23465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23465:1876035276864640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127170.333468:0:23465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127170.333567:0:23465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127170.333612:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276864640 00000100:00100000:0.0:1789127170.333618:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276864640 00000100:00100000:0.0:1789127170.333681:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127170.333689:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+9:23465:x1876035276864640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127170.334239:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+9:23465:x1876035276864640:12345-0@lo:502:llog_process_th.0 Request processed in 549us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127170.334253:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127170.334327:0:23465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23465:1876035276864640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127170.334352:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127170.334362:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127170.334376:0:23465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789127170.334381:0:23465:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789127170.334384:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789127170.334398:0:23465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff994102ebb490) 00000020:00000080:1.0:1789127170.334413:0:23465:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789127170.334418:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789127170.334485:0:23465:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789127170.334492:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ec3c3 00000020:00000080:1.0:1789127170.334871:0:23465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789127170.334876:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127170.334880:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127170.334882:0:23465:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789127170.334885:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127170.334888:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127170.334890:0:23465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789127170.334894:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789127170.334901:0:23465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff994102ebced8) 00000020:00000080:1.0:1789127170.334912:0:23465:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789127170.334916:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789127170.334917:0:23465:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789127170.334920:0:23465:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789127170.334926:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789127170.334990:0:23465:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994103e26000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789127170.335003:0:23465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff994102eb8000) 00000020:00000080:1.0:1789127170.335011:0:23465:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789127170.335069:0:23465:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789127170.335074:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ec3d8 00000020:00000080:1.0:1789127170.335157:0:23465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789127170.335163:0:23465:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789127170.335167:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa840b4da666ec3df 00080000:01000000:1.0:1789127170.335172:0:23465:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789127170.335174:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ec3e6 00010000:00010000:2.0:1789127170.405074:0:23465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789127170.406713:0:23465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1789127170.407189:0:23465:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789127170.407756:0:23465:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99410508b490) 00000020:00000080:2.0:1789127170.407772:0:23465:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789127170.407832:0:23465:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789127170.407839:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ec3f4 00000020:00000080:3.0:1789127170.411349:0:23465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789127170.422562:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa840b4da666ec3fb 00000020:00000080:3.0:1789127170.423061:0:23465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789127170.423073:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127170.423079:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127170.423081:0:23465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789127170.423085:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789127170.423088:0:23465:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789127170.423089:0:23465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127170.423090:0:23465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127170.423092:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789127170.423094:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127170.423095:0:23465:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789127170.423098:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127170.423102:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127170.423103:0:23465:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789127170.423107:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789127170.423159:0:23465:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789127170.423177:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127170.423180:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127170.423186:0:23465:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789127170.423189:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127170.423192:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127170.423193:0:23465:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789127170.423196:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127170.423200:0:23465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:00000080:3.0:1789127170.423223:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127170.423236:0:23465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9942290f0000) 00000020:00000080:3.0:1789127170.423251:0:23465:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789127170.423256:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127170.423325:0:23465:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789127170.423331:0:23465:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789127170.423339:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ec409 00010000:00080000:3.0:1789127170.423379:0:23465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994220359800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789127170.425005:0:23465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789127170.427440:0:23465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789127170.427455:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789127170.427507:0:23465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789127170.427536:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ec410 00000100:00080000:2.0:1789127170.427545:0:23465:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127170.427552:0:23465:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994220359800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127170.427788:0:23465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104060780 x1876035276864768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127170.427865:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276864768:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789127170.427931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.428023:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276864768 00000100:00100000:0.0:1789127170.428030:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276864768 00000100:00100000:0.0:1789127170.428074:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127170.428081:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276864768:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789127170.428097:0:23452:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789127170.428836:0:23465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789127170.428915:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127170.428920:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127170.428922:0:23465:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789127170.428925:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789127170.428928:0:23465:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789127170.428929:0:23465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127170.428931:0:23465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127170.428932:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789127170.428934:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127170.428936:0:23465:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789127170.428938:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789127170.428942:0:23465:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789127170.428945:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127170.428946:0:23465:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789127170.428949:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789127170.428952:0:23465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:2.0:1789127170.428973:0:23465:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789127170.428976:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127170.428989:0:23465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99410508ced8) 00000020:00000080:2.0:1789127170.429004:0:23465:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789127170.429009:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789127170.429175:0:23465:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789127170.429181:0:23465:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789127170.429188:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ec41e 00010000:00080000:2.0:1789127170.429284:0:23465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99423d250000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1789127170.429513:0:23465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789127170.433534:0:23465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789127170.433772:0:23465:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789127170.437921:0:23465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127170.439204:0:23465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:0.0:1789127170.444450:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276864768:12345-0@lo:38:llog_process_th.0 Request processed in 16360us (16511us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127170.444465:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789127170.444551:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994220359800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127170.444557:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127170.444569:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276864768:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789127170.445452:0:23465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1789127170.446188:0:23471:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789127170.446194:0:23471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789127170.447176:0:23465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789127170.447189:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789127170.447226:0:23465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789127170.447244:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ec425 00000100:00080000:3.0:1789127170.447254:0:23465:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127170.447259:0:23465:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99423d250000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127170.447292:0:23465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422051c780 x1876035276864896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127170.447349:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276864896:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789127170.447423:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276864896 offset 0 length 520: 4 00000100:00080000:3.0:1789127170.447482:0:23465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789127170.447604:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127170.447608:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127170.447610:0:23465:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789127170.447613:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789127170.447623:0:23465:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1789127170.447624:0:23465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127170.447626:0:23465:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127170.447627:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789127170.447630:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127170.447631:0:23465:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789127170.447634:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127170.447638:0:23465:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789127170.447641:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127170.447642:0:23465:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789127170.447646:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127170.447674:0:23465:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:3.0:1789127170.447696:0:23465:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789127170.447699:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127170.447710:0:23465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9942290f4ed8) 00000020:00000080:3.0:1789127170.447723:0:23465:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789127170.447727:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127170.447781:0:23465:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789127170.447787:0:23465:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789127170.447792:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa840b4da666ec433 00010000:00080000:3.0:1789127170.447839:0:23465:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99422d543000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789127170.448038:0:23465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789127170.448235:0:23465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789127170.448249:0:23465:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789127170.449976:0:23465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127170.450226:0:23465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789127170.450341:0:23465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1789127170.452479:0:23473:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789127170.452486:0:23473:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789127170.453424:0:23465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789127170.453634:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789127170.453697:0:23465:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789127170.453783:0:23465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ec43a 00000100:00080000:2.0:1789127170.453794:0:23465:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127170.453800:0:23465:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422d543000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127170.453835:0:23465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104060780 x1876035276865024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127170.453856:0:23465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789127170.453921:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276865024:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789127170.453972:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276865024 offset 0 length 520: 4 00000020:01000000:2.0:1789127170.454042:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127170.454047:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127170.454049:0:23465:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789127170.454052:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127170.454056:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127170.454058:0:23465:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127170.454060:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127170.454062:0:23465:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789127170.454065:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127170.454067:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127170.454068:0:23465:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789127170.454070:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127170.454073:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127170.454134:0:23465:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789127170.454142:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789127170.454181:0:23465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23465:1876035276865152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127170.454231:0:23465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127170.454254:0:23465:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0cea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127170.454269:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276865152 00000100:00100000:0.0:1789127170.454276:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276865152 00000100:00100000:0.0:1789127170.454362:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127170.454383:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+9:23465:x1876035276865152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127170.454562:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+9:23465:x1876035276865152:12345-0@lo:502:llog_process_th.0 Request processed in 181us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127170.454569:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127170.454688:0:23465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23465:1876035276865152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127170.454727:0:23465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127170.454732:0:23465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127170.454734:0:23465:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789127170.454737:0:23465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789127170.454899:0:23426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789127170.454919:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789127170.454974:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ec3ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec3b5 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.454982:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99420148f400/0xa840b4da666ec3ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec3b5 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127170.454988:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994103e26000 from 1 10000000:01000000:0.0:1789127170.454990:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127170.455023:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.455031:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.455041:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127170.455119:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127170.455153:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.455183:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127170.455248:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276865280 00000100:00100000:1.0:1789127170.455253:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276865280 00000100:00100000:1.0:1789127170.455287:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127170.455295:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+9:23426:x1876035276865280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127170.455304:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127170.455319:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec441 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.455339:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec441 expref: 10 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.455348:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec441 expref: 10 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.455356:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ee00, rc 0) 00000100:00100000:1.0:1789127170.455401:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+10:23426:x1876035276865280:12345-0@lo:101:mount.lustre.0 Request processed in 106us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127170.455414:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127170.455668:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127170.455682:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.455693:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127170.456343:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865408:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789127170.456398:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.456436:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.456566:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276865408 00000100:00100000:2.0:1789127170.456571:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276865408 00000100:00100000:2.0:1789127170.456609:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127170.456617:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+10:23426:x1876035276865408:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789127170.456632:0:23441:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789127170.456636:0:23441:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789127170.456974:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+10:23426:x1876035276865408:12345-0@lo:256:mount.lustre.0 Request processed in 357us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127170.456982:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127170.457139:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865408:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789127170.458049:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127170.458178:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.458190:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127170.458214:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994103e26000 from 1 10000000:01000000:0.0:1789127170.458217:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127170.458256:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.458265:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.458274:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127170.458292:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865536:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127170.458337:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.458383:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127170.458448:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276865536 00000100:00100000:3.0:1789127170.458454:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276865536 00000100:00100000:3.0:1789127170.458505:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127170.458513:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+10:23426:x1876035276865536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127170.458524:0:23442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127170.458537:0:23442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec44f expref: -99 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127170.458558:0:23442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec44f expref: 11 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127170.458915:0:23442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec44f expref: 11 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127170.458927:0:23442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2800, rc 0) 00000100:00100000:3.0:1789127170.458968:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23426:x1876035276865536:12345-0@lo:101:mount.lustre.0 Request processed in 456us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127170.458975:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127170.459124:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865536:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127170.459141:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.459149:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127170.459224:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865664:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127170.459250:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.459276:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.459326:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276865664 00000100:00100000:2.0:1789127170.459330:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276865664 00000100:00100000:2.0:1789127170.459362:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127170.459381:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23426:x1876035276865664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127170.459638:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23426:x1876035276865664:12345-0@lo:501:mount.lustre.0 Request processed in 257us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127170.459680:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865664:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127170.459682:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127170.459707:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865792:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127170.459751:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.459779:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127170.459793:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276865792 00000100:00100000:3.0:1789127170.459797:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276865792 00000100:00100000:3.0:1789127170.459862:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127170.459869:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23426:x1876035276865792:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127170.459951:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23426:x1876035276865792:12345-0@lo:503:mount.lustre.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127170.459958:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127170.459977:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276865792:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127170.460470:0:23475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23475:1876035276865920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127170.460572:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.460592:0:23475:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.460638:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276865920 00000100:00100000:2.0:1789127170.460641:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276865920 00000100:00100000:2.0:1789127170.460737:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127170.460744:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23475:x1876035276865920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127170.461273:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23475:x1876035276865920:12345-0@lo:502:llog_process_th.0 Request processed in 528us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127170.461282:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127170.461361:0:23475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23475:1876035276865920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127170.462630:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127170.462642:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.462644:0:23475:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789127170.462665:0:23475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994103e26000 00000020:00000080:0.0:1789127170.462668:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127170.462677:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127170.462679:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.462681:0:23475:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789127170.462683:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127170.462685:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.462686:0:23475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789127170.462689:0:23475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff994103e26000 00000020:00000080:0.0:1789127170.462691:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127170.462766:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127170.462769:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.462770:0:23475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789127170.462772:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127170.462775:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.462776:0:23475:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127170.462779:0:23475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994103e26000 00000020:00000080:0.0:1789127170.462781:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127170.462797:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127170.462808:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.462810:0:23475:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127170.463563:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127170.463569:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.463571:0:23475:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127170.463576:0:23475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994103e26000 00000020:00000080:0.0:1789127170.463578:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127170.463602:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127170.463605:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.463606:0:23475:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127170.463609:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127170.463611:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.463613:0:23475:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789127170.463616:0:23475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994103e26000 00000020:00000080:0.0:1789127170.463618:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127170.463633:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127170.463636:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.463638:0:23475:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789127170.463640:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127170.463643:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.463644:0:23475:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789127170.463682:0:23475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff994103e26000 00000020:00000080:0.0:1789127170.463684:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789127170.463739:0:23475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23475:1876035276866048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127170.463809:0:23475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.464604:0:23475:0:(client.c:2715:ptlrpc_set_wait()) set ffff994220356300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.464705:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276866048 00000100:00100000:2.0:1789127170.464712:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276866048 00000100:00100000:2.0:1789127170.464756:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127170.464766:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23475:x1876035276866048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127170.465269:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23475:x1876035276866048:12345-0@lo:502:llog_process_th.0 Request processed in 503us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127170.465278:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127170.465348:0:23475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23475:1876035276866048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127170.465390:0:23475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127170.465397:0:23475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127170.465399:0:23475:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789127170.465403:0:23475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:2.0:1789127170.466175:0:23426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789127170.466201:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127170.466222:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.466234:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127170.466298:0:23426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789127170.466302:0:23426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff994103e26000 10000000:01000000:2.0:1789127170.466305:0:23426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff994103e26000 10000000:01000000:2.0:1789127170.466308:0:23426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127170.466314:0:23426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff994103e26000 from 1 10000000:01000000:2.0:1789127170.466317:0:23426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127170.466349:0:23426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588a00/0xa840b4da666ec45d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.466358:0:23426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236588a00/0xa840b4da666ec45d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.466386:0:23426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588a00/0xa840b4da666ec45d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127170.466408:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276866176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127170.466457:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127170.466897:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276866176 00000100:00100000:2.0:1789127170.466904:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276866176 00000100:00100000:2.0:1789127170.468504:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127170.468524:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23426:x1876035276866176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127170.468540:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127170.468556:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588e00/0xa840b4da666ec464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec45d expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.468584:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588e00/0xa840b4da666ec464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec45d expref: 12 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.468595:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588e00/0xa840b4da666ec464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec45d expref: 12 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.468604:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588e00, rc 0) 00000100:00100000:2.0:1789127170.468797:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23426:x1876035276866176:12345-0@lo:101:mount.lustre.0 Request processed in 277us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127170.468805:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127170.473843:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.473884:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276866176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127170.473909:0:23426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588a00/0xa840b4da666ec45d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec464 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127170.473929:0:23426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588a00/0xa840b4da666ec45d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec464 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127170.474010:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276866304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127170.474078:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127170.474119:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276866304 00000100:00100000:2.0:1789127170.474125:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276866304 00000100:00100000:2.0:1789127170.474161:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127170.474169:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23426:x1876035276866304:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127170.474280:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23426:x1876035276866304:12345-0@lo:501:mount.lustre.0 Request processed in 111us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127170.474287:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127170.474316:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.474326:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276866304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127170.474350:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276866432:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127170.474399:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127170.474413:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.474428:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276866432 00000100:00100000:2.0:1789127170.474431:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276866432 00000100:00100000:2.0:1789127170.474457:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127170.474463:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23426:x1876035276866432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127170.475314:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23426:x1876035276866432:12345-0@lo:503:mount.lustre.0 Request processed in 847us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127170.475323:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127170.477092:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276866432:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127170.482334:0:23479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23479:1876035276866560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127170.482432:0:23479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127170.482483:0:23479:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423e0ce0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.483580:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276866560 00000100:00100000:2.0:1789127170.483591:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276866560 00000100:00100000:2.0:1789127170.483716:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127170.483728:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23479:x1876035276866560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127170.483867:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23479:x1876035276866560:12345-0@lo:502:llog_process_th.0 Request processed in 141us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127170.483875:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127170.483913:0:23479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23479:1876035276866560:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789127170.483983:0:23479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789127170.484000:0:23479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff994212213490) 00000020:00000080:3.0:1789127170.484020:0:23479:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789127170.484174:0:23479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff994103e26000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789127170.484179:0:23479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff994103e26000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789127170.484182:0:23479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff994103e26000 4 00010000:00080000:3.0:1789127170.484209:0:23479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9942405eb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789127170.487278:0:23479:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789127170.491002:0:23479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789127170.491048:0:23479:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127170.491064:0:23479:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa840b4da666ec472 00000100:00080000:2.0:1789127170.491074:0:23479:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127170.491080:0:23479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9942405eb800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127170.491115:0:23479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104060f00 x1876035276866688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127170.491156:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276866688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127170.491216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789127170.491265:0:23479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789127170.493296:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276866688 00000100:00100000:2.0:1789127170.493309:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276866688 00000100:00100000:2.0:1789127170.493375:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127170.493383:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104063c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276866688:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127170.493477:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104063c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276866688:12345-0@lo:38:llog_process_th.0 Request processed in 93us (2259us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789127170.493484:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127170.493524:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127170.493531:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942405eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127170.493535:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789127170.493545:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276866688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127170.496537:0:23479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23479:1876035276866816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127170.496616:0:23479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127170.496688:0:23479:0:(client.c:2715:ptlrpc_set_wait()) set ffff994234696f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127170.498294:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276866816 00000100:00100000:0.0:1789127170.498306:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276866816 00000100:00100000:0.0:1789127170.498360:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127170.498383:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23479:x1876035276866816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127170.498543:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23479:x1876035276866816:12345-0@lo:502:llog_process_th.0 Request processed in 163us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127170.498552:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127170.498785:0:23479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23479:1876035276866816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127170.498843:0:23479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23479:1876035276866944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127170.498884:0:23479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127170.498912:0:23479:0:(client.c:2715:ptlrpc_set_wait()) set ffff994234696f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127170.498926:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276866944 00000100:00100000:3.0:1789127170.498932:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276866944 00000100:00100000:3.0:1789127170.498966:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127170.498976:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23479:x1876035276866944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127170.499071:0:23479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23479:1876035276866944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127170.499073:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23479:x1876035276866944:12345-0@lo:502:llog_process_th.0 Request processed in 98us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127170.499084:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000040:00080000:2.0:1789127170.499096:0:23479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789127170.501104:0:23426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789127170.501137:0:23426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127170.501159:0:23426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588a00/0xa840b4da666ec45d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec464 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127170.501172:0:23426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236588a00/0xa840b4da666ec45d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec464 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127170.501227:0:23426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789127170.501229:0:23426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789127170.501230:0:23426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127170.501232:0:23426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127170.501233:0:23426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127170.501239:0:23426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127170.501240:0:23426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127170.501241:0:23426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789127170.501243:0:23426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127170.501244:0:23426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127170.501248:0:23426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789127170.501250:0:23426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127170.501251:0:23426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789127170.501252:0:23426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127170.501253:0:23426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127170.501254:0:23426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127170.501255:0:23426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127170.501255:0:23426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127170.501256:0:23426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789127170.501257:0:23426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127170.501258:0:23426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127170.501280:0:23426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789127170.501295:0:23426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276867072:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127170.501349:0:23426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127170.501394:0:23426:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127170.502092:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276867072 00000100:00100000:2.0:1789127170.502098:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276867072 00000100:00100000:2.0:1789127170.502150:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789127170.502161:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23426:x1876035276867072:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789127170.502186:0:23442:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789127170.502198:0:23442:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789127170.507441:0:23442:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789127170.507466:0:23442:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789127170.508151:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23426:x1876035276867072:12345-0@lo:253:mount.lustre.0 Request processed in 5988us (6797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127170.508164:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789127170.508392:0:23426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23426:1876035276867072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789127170.508406:0:23426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789127170.508409:0:23426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127170.508423:0:23426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789127170.508424:0:23426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127170.508426:0:23426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127170.508427:0:23426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127170.508428:0:23426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127170.508430:0:23426:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789127170.508437:0:23426:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789127170.508439:0:23426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127170.508451:0:23426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789127170.508472:0:23426:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789127170.508708:0:23463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789127170.508713:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789127170.508736:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.508751:0:23463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec441 expref: 11 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.508759:0:23463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.508793:0:23463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec441 expref: 11 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127170.508807:0:23463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec441 expref: 11 pid: 23439 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127170.509536:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276867200:0@lo:104: 00000100:00100000:0.0:1789127170.509590:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127170.511094:0:23463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127170.513821:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276867200 00000100:00100000:1.0:1789127170.513833:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276867200 00000100:00100000:1.0:1789127170.513868:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127170.513875:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276867200:12345-0@lo:104: 00010000:00010000:1.0:1789127170.513889:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.513958:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127170.513962:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276867200:12345-0@lo:104: Request processed in 88us (4373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127170.513968:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127170.514013:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276867200:0@lo:104: 00010000:00010000:1.0:1789127170.514051:0:23463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514072:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127170.514078:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514086:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cba00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:1.0:1789127170.514090:0:23436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514109:0:23436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127170.514122:0:23436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127170.514135:0:23436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127170.514168:0:23436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514175:0:23436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127170.514580:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514589:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364cba00/0xa840b4da666ec441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec448 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514606:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127170.514608:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127170.514611:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127170.514637:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127170.514680:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276867328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127170.514796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127170.514860:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276867328 00000100:00100000:1.0:1789127170.514865:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276867328 00010000:00010000:1.0:1789127170.514883:0:23432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec441 expref: 12 pid: 23439 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127170.514905:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127170.514911:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:3639:x1876035276867328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127170.514934:0:23432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127170.514940:0:23432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec441 expref: 12 pid: 23439 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514951:0:23432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec441 expref: 12 pid: 23439 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514970:0:23432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148ee00/0xa840b4da666ec448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec441 expref: 12 pid: 23439 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514983:0:23432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.514991:0:23432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789127170.515006:0:23432:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006293340s 00010000:00010000:1.0:1789127170.515011:0:23432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.515018:0:23432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.515035:0:23432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.515041:0:23432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.515046:0:23432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cbc00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127170.515050:0:23432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.515057:0:23432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.515350:0:23432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.515377:0:23432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127170.515412:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:3639:x1876035276867328:12345-0@lo:103:ldlm_bl.0 Request processed in 501us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127170.515419:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789127170.515445:0:23463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.515454:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127170.515460:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cbc00/0xa840b4da666ec479 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127170.515553:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276867328:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789127170.529642:0:23426:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1789127170.530411:0:23426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789127170.530413:0:23488:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1789127170.530419:0:23488:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1789127170.531355:0:23490:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789127170.531385:0:23426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789127170.531715:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127170.534324:0:23490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789127170.534406:0:23490:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1789127170.536893:0:23491:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff994105018b40 x1876035276867456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127170.536906:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000040:01000000:2.0:1789127170.537200:0:23426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789127170.537239:0:23426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789127170.537703:0:23426:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789127170.537710:0:23426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789127170.537744:0:23426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127170.541120:0:23426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789127170.546960:0:23426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789127170.547028:0:23426:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789127170.548970:0:23426:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1789127170.549595:0:23426:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1789127170.552983:0:23426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1789127170.555863:0:23426:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789127170.555902:0:23426:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb305419bb988 00100000:10000000:2.0:1789127170.555909:0:23426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789127170.557174:0:23426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789127170.557190:0:23426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789127170.557208:0:23426:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789127170.557224:0:23426:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789127170.558018:0:23426:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127170.558198:0:23426:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127171.248637:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127171.567717:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000040:00080000:0.0:1789127171.569854:0:23484:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789127171.570042:0:23484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 10000000:01000000:2.0:1789127171.573817:0:23444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789127171.573829:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994103e26000 from 11 10000000:01000000:2.0:1789127171.573837:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789127171.574109:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127171.574140:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127171.574155:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127171.574189:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276867584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127171.574619:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127171.575826:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127171.575872:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276867584 00000100:00100000:2.0:1789127171.576450:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276867584 00000100:00100000:2.0:1789127171.576585:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127171.576601:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+11:23444:x1876035276867584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127171.576623:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127171.576680:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec480 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127171.576977:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec480 expref: 12 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127171.576991:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec480 expref: 12 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127171.577002:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236588c00, rc 0) 00000100:00100000:2.0:1789127171.577104:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23444:x1876035276867584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 507us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127171.577113:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127171.578828:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276867584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127171.578863:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127171.578944:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127171.579862:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276867712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789127171.580156:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127171.580262:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127171.580430:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276867712 00000100:00100000:1.0:1789127171.580439:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276867712 00000100:00100000:1.0:1789127171.580548:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127171.580560:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23444:x1876035276867712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789127171.580589:0:23442:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789127171.580608:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789127171.580617:0:23442:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789127171.580767:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:23444:x1876035276867712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 208us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127171.580777:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127171.581077:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276867712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789127171.581138:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127171.581150:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127171.581162:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127171.585676:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789127171.585695:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789127172.267809:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127172.586847:0:23484:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789127172.586857:0:23484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127172.586994:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1789127172.587033:0:23484:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789127172.587156:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000040:00080000:1.0:1789127172.587194:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1789127173.290867:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127173.610796:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789127174.315114:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127174.635715:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000001:02000400:1.0:1789127174.698018:0:23734:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789127175.339246:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789127175.501494:0:23786:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127175.501794:0:23786:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789127175.660188:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000100:00080000:3.0:1789127175.854279:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789127175.854286:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789127175.854290:0:37:0:(import.c:65:import_set_state_nolock()) ffff994220359800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127175.854298:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:3.0:1789127175.854304:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789127175.854311:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994220359800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127175.854345:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422051f840 x1876035276867968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127175.854362:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127175.854381:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127175.854384:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127175.854387:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127175.854390:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789127175.854392:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789127175.854394:0:37:0:(import.c:65:import_set_state_nolock()) ffff9942405eb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127175.854401:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9942405eb800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127175.854415:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99422051ed00 x1876035276868096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127175.854466:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127175.854480:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276867840:0@lo:400:kworker.0 00000100:00100000:3.0:1789127175.854570:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127175.854624:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276867968:0@lo:38:kworker.0 00000100:00100000:3.0:1789127175.854684:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127175.854704:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276868096:0@lo:38:kworker.0 00000100:00100000:3.0:1789127175.854748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127175.854791:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276867968 00000100:00100000:3.0:1789127175.854797:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276867968 00000100:00100000:3.0:1789127175.854829:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127175.854836:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276867968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789127175.854854:0:23453:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789127175.854893:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276867968:12345-0@lo:38:kworker.0 Request processed in 56us (209us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789127175.854900:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127175.854945:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276868096 00000100:00100000:3.0:1789127175.854949:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276868096 00000100:00100000:3.0:1789127175.854968:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127175.854972:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276868096:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789127175.854988:0:23449:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:3.0:1789127175.855021:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa840b4da666ec48e 00000004:00100000:3.0:1789127175.855036:0:23449:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789127175.855163:0:23449:0:(import.c:65:import_set_state_nolock()) ffff9942405e9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127175.855199:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876035276868096:12345-0@lo:38:kworker.0 Request processed in 225us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127175.855206:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789127175.855236:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994220359800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127175.855240:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789127175.855243:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276867968:0@lo:38:kworker.0 00010000:00080000:3.0:1789127175.855254:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99422051ed00 x1876035276868096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127175.855266:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789127175.855272:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789127175.855276:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789127175.855278:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9942405eb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789127175.855282:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876035276868096:0@lo:38:kworker.0 00000100:00100000:2.0:1789127175.855740:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276867840 00000100:00100000:2.0:1789127175.855746:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276867840 00000100:00100000:2.0:1789127175.855777:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127175.855785:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:3642:x1876035276867840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127175.855830:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:3642:x1876035276867840:12345-0@lo:400:kworker.0 Request processed in 47us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127175.855837:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127175.855877:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276867840:0@lo:400:kworker.0 00000020:00000004:3.0:1789127176.268836:0:23836:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127176.269061:0:23836:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127176.363636:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127176.683212:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789127177.389774:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127177.706868:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789127178.413138:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127178.735695:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789127179.439933:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127179.761609:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789127180.458795:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127180.778724:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000100:00100000:0.0:1789127180.976542:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127170/real 1789127170] req@ffff994104060780 x1876035276865024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127180.976570:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994104060780 x1876035276865024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127180.976580:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127170/real 1789127170] req@ffff99422051c780 x1876035276864896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127180 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127180.976591:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99422051c780 x1876035276864896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127180 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789127180.976608:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127180.976620:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789127180.976623:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276865024:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789127180.976629:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d250000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127180.976633:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789127180.976636:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276864896:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789127180.976719:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789127180.976723:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789127180.976732:0:37:0:(import.c:65:import_set_state_nolock()) ffff994220359800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127180.976737:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 601 00000100:00080000:0.0:1789127180.976742:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789127180.976748:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994220359800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127180.976767:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941050192c0 x1876035276868352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127180.976779:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127180.976782:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789127180.976783:0:37:0:(import.c:65:import_set_state_nolock()) ffff99423d250000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127180.976787:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:0.0:1789127180.976789:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789127180.976793:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99423d250000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127180.977315:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501a580 x1876035276868480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127180.977326:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127180.977328:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789127180.977330:0:37:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127180.977332:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 595 00000100:00080000:0.0:1789127180.977334:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789127180.977338:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422d543000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127180.977346:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501b0c0 x1876035276868608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127180.977827:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127180.977844:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276868736:0@lo:400:kworker.0 00000100:00100000:3.0:1789127180.977918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127180.978645:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276868224:0@lo:400:kworker.0 00000100:00100000:2.0:1789127180.978719:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127180.978797:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276868224 00000100:00100000:3.0:1789127180.978805:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276868224 00000100:00100000:2.0:1789127180.978805:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276868352:0@lo:38:kworker.0 00000100:00100000:2.0:1789127180.978841:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127180.978859:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127180.978866:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276868480:0@lo:8:kworker.0 00000100:00100000:3.0:1789127180.978872:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:3642:x1876035276868224:12345-0@lo:400:kworker.0 00000400:00000100:2.0:1789127180.978889:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276868480 offset 0 length 520: 4 00000100:00100000:2.0:1789127180.978904:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276868608:0@lo:8:kworker.0 00000400:00000100:2.0:1789127180.978925:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276868608 offset 0 length 520: 4 00000100:00100000:2.0:1789127180.978957:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276868352 00000100:00100000:2.0:1789127180.978966:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276868352 00000100:00100000:0.0:1789127180.979231:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276868736 00000100:00100000:0.0:1789127180.979236:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276868736 00000100:00100000:0.0:1789127180.979340:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127180.979355:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276868736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127180.979480:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276868736:12345-0@lo:400:kworker.0 Request processed in 126us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127180.979487:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127180.980420:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127180.980428:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104061e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276868352:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789127180.980445:0:23453:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789127180.982695:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:3642:x1876035276868224:12345-0@lo:400:kworker.0 Request processed in 3818us (3966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127180.982711:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789127180.982805:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99410501b480 x1876035276868736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127180.982891:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276868736:0@lo:400:kworker.0 00000100:00100000:0.0:1789127181.000755:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276868224:0@lo:400:kworker.0 00000100:00100000:2.0:1789127181.009164:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104061e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276868352:12345-0@lo:38:kworker.0 Request processed in 28729us (30316us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789127181.009179:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789127181.009548:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994220359800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127181.009555:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789127181.009559:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276868352:0@lo:38:kworker.0 00010000:00010000:3.0:1789127181.488632:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127181.808716:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000020:01000004:2.0:1789127182.178983:0:24181:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789127182.178987:0:24181:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789127182.178988:0:24181:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789127182.179887:0:24181:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99422043b000 00000020:01000004:2.0:1789127182.179907:0:24181:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789127182.179920:0:24181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789127182.179935:0:24181:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff994105088000) 00000020:00000080:2.0:1789127182.179950:0:24181:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789127182.238165:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789127182.239299:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789127182.241811:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.242021:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.242211:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.243048:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.243247:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.244703:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.251138:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.251736:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.251956:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.252150:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.252961:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.253207:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.253830:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.254142:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.254714:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.255157:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.260569:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.261047:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.261723:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.263366:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.264448:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.264847:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.265736:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.266020:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.266263:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.266591:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.266880:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.267079:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.267500:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.267977:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789127182.268576:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.268870:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789127182.271918:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789127182.272335:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789127182.273155:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789127182.273374:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789127182.274107:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789127182.274448:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789127182.275222:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789127182.275546:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789127182.275792:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789127182.276052:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789127182.276248:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1789127182.276458:0:24181:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1789127182.278745:0:24181:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789127182.278990:0:24181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789127182.279001:0:24181:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789127182.279014:0:24181:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ec49c 00000020:01000004:2.0:1789127182.279020:0:24181:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789127182.279041:0:24181:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789127182.279045:0:24181:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789127182.279050:0:24181:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789127182.279075:0:24181:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789127182.279079:0:24181:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789127182.284511:0:24181:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789127182.284551:0:24181:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789127182.284556:0:24181:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789127182.284557:0:24181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127182.284559:0:24181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127182.284560:0:24181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127182.284561:0:24181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127182.284562:0:24181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127182.284563:0:24181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127182.284565:0:24181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127182.284567:0:24181:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789127182.284570:0:24181:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789127182.284572:0:24181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127182.284573:0:24181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127182.284579:0:24181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127182.284580:0:24181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127182.284581:0:24181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127182.284582:0:24181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127182.284583:0:24181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127182.284584:0:24181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127182.284585:0:24181:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789127182.284609:0:24181:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789127182.284627:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276868864:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127182.284731:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.284777:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127182.284915:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276868864 00000100:00100000:2.0:1789127182.284922:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276868864 00000100:00100000:2.0:1789127182.285057:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127182.285067:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:24181:x1876035276868864:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789127182.285098:0:23439:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789127182.285101:0:23439:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789127182.285109:0:23439:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789127182.285620:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:24181:x1876035276868864:12345-0@lo:253:mount.lustre.0 Request processed in 553us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127182.285630:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127182.285763:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276868864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789127182.285773:0:24181:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789127182.285776:0:24181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789127182.285777:0:24181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127182.285778:0:24181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127182.285779:0:24181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127182.285780:0:24181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127182.285781:0:24181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127182.285782:0:24181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127182.285783:0:24181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127182.285784:0:24181:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789127182.285801:0:24181:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99422043b000 from lustre-MDT0001 10000000:01000000:3.0:1789127182.285828:0:24181:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789127182.285831:0:24181:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789127182.285837:0:24181:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9942290f1a48 local copy 00010000:00010000:3.0:1789127182.285848:0:24181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127182.285931:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276868992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127182.287224:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.287273:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.287346:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276868992 00000100:00100000:1.0:1789127182.287353:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276868992 00000100:00100000:1.0:1789127182.287445:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127182.287455:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:24181:x1876035276868992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127182.287547:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:24181:x1876035276868992:12345-0@lo:501:mount.lustre.0 Request processed in 94us (327us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789127182.287555:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127182.287623:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276868992:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789127182.287681:0:24181:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789127182.287703:0:24181:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789127182.287710:0:24181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.287719:0:24181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127182.287749:0:24181:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99422043b000 10000000:01000000:3.0:1789127182.287754:0:24181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789127182.287759:0:24181:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9942290f1a48 10000000:01000000:3.0:1789127182.287761:0:24181:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789127182.287764:0:24181:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9942290f1a48 from 1 10000000:01000000:3.0:1789127182.287767:0:24181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789127182.287795:0:24181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2000/0xa840b4da666ec4a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.287803:0:24181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2000/0xa840b4da666ec4a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.287811:0:24181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2000/0xa840b4da666ec4a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127182.287829:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127182.287858:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.288253:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127182.288312:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276869120 00000100:00100000:0.0:1789127182.288318:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276869120 00000100:00100000:0.0:1789127182.288346:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127182.288354:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+12:24181:x1876035276869120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127182.288364:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127182.288378:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cba00/0xa840b4da666ec4aa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec4a3 expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.288400:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cba00/0xa840b4da666ec4aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec4a3 expref: 13 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.288505:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cba00/0xa840b4da666ec4aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec4a3 expref: 13 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.288515:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cba00, rc 0) 00000100:00100000:0.0:1789127182.288559:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+13:24181:x1876035276869120:12345-0@lo:101:mount.lustre.0 Request processed in 206us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127182.288565:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127182.288642:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127182.288675:0:24181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2000/0xa840b4da666ec4a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec4aa expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.288693:0:24181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2000/0xa840b4da666ec4a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec4aa expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127182.288710:0:24181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789127182.288728:0:24181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2000/0xa840b4da666ec4a3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec4aa expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.288735:0:24181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2000/0xa840b4da666ec4a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec4aa expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127182.288743:0:24181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99422043b000 10000000:01000000:3.0:1789127182.288747:0:24181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789127182.288750:0:24181:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99422043b000 from 1 10000000:01000000:3.0:1789127182.288753:0:24181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789127182.288769:0:24181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ec4b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.288776:0:24181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ec4b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.288783:0:24181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ec4b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127182.288796:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127182.288824:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.288836:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127182.288894:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276869248 00000100:00100000:0.0:1789127182.288899:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276869248 00000100:00100000:0.0:1789127182.288925:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789127182.288932:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+13:24181:x1876035276869248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127182.288940:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127182.288948:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cbe00/0xa840b4da666ec4b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec4b1 expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.288973:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cbe00/0xa840b4da666ec4b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec4b1 expref: 14 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.288980:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cbe00/0xa840b4da666ec4b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec4b1 expref: 14 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.288986:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cbe00, rc 0) 00000100:00100000:0.0:1789127182.289053:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+14:24181:x1876035276869248:12345-0@lo:101:mount.lustre.0 Request processed in 122us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127182.289059:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127182.290778:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127182.290798:0:24181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ec4b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec4b8 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.290821:0:24181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ec4b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec4b8 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127182.290836:0:24181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789127182.290852:0:24181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ec4b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec4b8 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.290860:0:24181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2200/0xa840b4da666ec4b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec4b8 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127182.290868:0:24181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789127182.290872:0:24181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127182.290878:0:24181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99422043b000 10000000:01000000:3.0:1789127182.290880:0:24181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789127182.290884:0:24181:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789127182.290886:0:24181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789127182.290911:0:24181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3800/0xa840b4da666ec4bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.290918:0:24181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3800/0xa840b4da666ec4bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.290925:0:24181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3800/0xa840b4da666ec4bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127182.290942:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127182.290985:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.291071:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.291586:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276869376 00000100:00100000:1.0:1789127182.291593:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276869376 00000100:00100000:0.0:1789127182.291814:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127182.291825:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+14:24181:x1876035276869376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127182.291838:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127182.291852:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cac00/0xa840b4da666ec4c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec4bf expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.291886:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cac00/0xa840b4da666ec4c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec4bf expref: 15 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.291897:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cac00/0xa840b4da666ec4c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec4bf expref: 15 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.291906:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cac00, rc 0) 00000100:00100000:0.0:1789127182.291968:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276869376:12345-0@lo:101:mount.lustre.0 Request processed in 144us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127182.291975:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127182.292005:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127182.292022:0:24181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3800/0xa840b4da666ec4bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec4c6 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.292031:0:24181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3800/0xa840b4da666ec4bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec4c6 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127182.293240:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1789127182.296577:0:24181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127182.301966:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789127182.302024:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1789127182.302040:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1789127182.302053:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1789127182.302066:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1789127182.302080:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1789127182.302093:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1789127182.302278:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1789127182.302309:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1789127182.302325:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1789127182.302577:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1789127182.302597:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1789127182.302610:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1789127182.302623:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1789127182.302635:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1789127182.302843:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1789127182.302866:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1789127182.302881:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1789127182.302897:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1789127182.302911:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1789127182.302924:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1789127182.302938:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1789127182.302952:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1789127182.302970:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1789127182.302985:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1789127182.302997:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1789127182.303008:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1789127182.303019:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1789127182.303030:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1789127182.303043:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1789127182.303059:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1789127182.303081:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1789127182.303094:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1789127182.303135:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1789127182.303150:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1789127182.303166:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1789127182.303193:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1789127182.303207:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1789127182.303222:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1789127182.303236:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1789127182.303249:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1789127182.303261:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1789127182.303272:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1789127182.303295:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1789127182.303325:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1789127182.303337:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1789127182.303456:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127182.303523:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.303849:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127182.304069:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276869504 00000100:00100000:2.0:1789127182.304078:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276869504 00000100:00100000:2.0:1789127182.304138:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789127182.304147:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276869504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127182.304541:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276869504:12345-0@lo:501:mount.lustre.0 Request processed in 394us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127182.304551:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789127182.304628:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127182.304702:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127182.304751:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127182.304780:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422033acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.305946:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276869632 00000100:00100000:3.0:1789127182.305954:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276869632 00000100:00100000:3.0:1789127182.306060:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127182.306069:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276869632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127182.307084:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276869632:12345-0@lo:503:mount.lustre.0 Request processed in 1012us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.307094:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789127182.307208:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869632:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789127182.307977:0:24181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127182.308062:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127182.308114:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127182.308160:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994236520cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.308747:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276869760 00000100:00100000:3.0:1789127182.308755:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276869760 00000100:00100000:3.0:1789127182.308805:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127182.308815:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276869760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127182.310145:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276869760:12345-0@lo:502:mount.lustre.0 Request processed in 1327us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.310168:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127182.310280:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127182.310540:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789127182.310571:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1789127182.310585:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1789127182.310599:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1789127182.310612:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1789127182.310643:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1789127182.310685:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1789127182.310699:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1789127182.310712:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1789127182.310725:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1789127182.310738:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1789127182.310752:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1789127182.310765:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1789127182.310779:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1789127182.310793:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1789127182.310807:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1789127182.310822:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1789127182.310837:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1789127182.310851:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1789127182.310865:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1789127182.310880:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1789127182.310907:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1789127182.310922:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1789127182.310943:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1789127182.310960:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1789127182.310973:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1789127182.311235:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1789127182.312279:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1789127182.312316:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1789127182.312331:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1789127182.312344:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1789127182.312357:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1789127182.312370:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1789127182.312383:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1789127182.312397:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1789127182.312411:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1789127182.312424:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1789127182.312437:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1789127182.312452:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1789127182.312465:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1789127182.312478:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1789127182.312491:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1789127182.312502:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1789127182.312515:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1789127182.312968:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050192c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127182.313053:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.313351:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276869888 00000100:00100000:3.0:1789127182.313359:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276869888 00000100:00100000:0.0:1789127182.313365:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994205268900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.313431:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789127182.313441:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276869888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127182.313558:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276869888:12345-0@lo:502:mount.lustre.0 Request processed in 118us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.313566:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127182.313608:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050192c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276869888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127182.313692:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1789127182.313703:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789127182.319680:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127182.319695:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127182.319697:0:24185:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789127182.319717:0:24185:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789127182.319720:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127182.319737:0:24185:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9941032dced8) 00000020:00000080:0.0:1789127182.319756:0:24185:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789127182.319762:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789127182.319835:0:24185:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789127182.319843:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ec4d4 00000020:00000080:0.0:1789127182.320063:0:24185:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789127182.320068:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127182.320072:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127182.320073:0:24185:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789127182.320076:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127182.320147:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127182.320150:0:24185:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789127182.320154:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127182.320162:0:24185:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9941032d8000) 00000020:00000080:0.0:1789127182.320172:0:24185:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789127182.320176:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789127182.320178:0:24185:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789127182.320181:0:24185:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789127182.320186:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789127182.320226:0:24185:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99422043b000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789127182.320239:0:24185:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9941032db490) 00000020:00000080:0.0:1789127182.320385:0:24185:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789127182.320475:0:24185:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789127182.320483:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ec4e9 00000020:00000080:0.0:1789127182.320722:0:24185:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789127182.320730:0:24185:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789127182.320734:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xa840b4da666ec4f0 00080000:01000000:0.0:1789127182.320741:0:24185:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789127182.320744:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ec4f7 00010000:00010000:2.0:1789127182.394924:0:24185:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789127182.395830:0:24185:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1789127182.396382:0:24185:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789127182.399883:0:24185:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789127182.399901:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127182.399908:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127182.399910:0:24185:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789127182.399915:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127182.399921:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127182.399923:0:24185:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789127182.399927:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127182.399932:0:24185:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:00000080:3.0:1789127182.399960:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127182.399975:0:24185:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff994212214ed8) 00000020:00000080:3.0:1789127182.399996:0:24185:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789127182.400001:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127182.400068:0:24185:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789127182.400076:0:24185:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789127182.400083:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ec505 00010000:00080000:3.0:1789127182.400115:0:24185:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994238d0e000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:3.0:1789127182.404792:0:24185:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789127182.408410:0:24185:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789127182.408425:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789127182.408466:0:24185:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789127182.408486:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ec50c 00000100:00080000:2.0:1789127182.408497:0:24185:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127182.408503:0:24185:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff994238d0e000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127182.408535:0:24185:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104060780 x1876035276870016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127182.408745:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276870016:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789127182.408810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789127182.408902:0:24185:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1789127182.408964:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127182.408969:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.409228:0:24185:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1789127182.409234:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789127182.409237:0:24185:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789127182.409244:0:24185:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127182.409247:0:24185:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127182.409248:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789127182.409251:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.409252:0:24185:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789127182.409255:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127182.409260:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.409261:0:24185:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1789127182.409265:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789127182.409308:0:24185:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789127182.409322:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127182.409325:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.409327:0:24185:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1789127182.409329:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789127182.409331:0:24185:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1789127182.409332:0:24185:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127182.409333:0:24185:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127182.409335:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789127182.409337:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.409338:0:24185:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789127182.409341:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789127182.409343:0:24185:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789127182.409347:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.409348:0:24185:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789127182.409351:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789127182.409354:0:24185:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:2.0:1789127182.409376:0:24185:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789127182.409379:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127182.409390:0:24185:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99423d003490) 00000020:00000080:2.0:1789127182.409402:0:24185:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789127182.409407:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789127182.409476:0:24185:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1789127182.409482:0:24185:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789127182.409494:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ec51a 00010000:00080000:2.0:1789127182.409521:0:24185:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99422d6b9000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.123@tcp at head 00000100:00080000:0.0:1789127182.409965:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789127182.409971:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789127182.409982:0:37:0:(import.c:65:import_set_state_nolock()) ffff994220359800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127182.409988:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:0.0:1789127182.409993:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789127182.409998:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994220359800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127182.410023:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941050192c0 x1876035276870144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127182.410047:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127182.410051:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127182.410053:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127182.410056:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127182.410142:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276870272:0@lo:400:kworker.0 00000100:00100000:3.0:1789127182.410252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127182.410308:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276870272 00000100:00100000:3.0:1789127182.410312:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276870144:0@lo:38:kworker.0 00000100:00100000:0.0:1789127182.410317:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276870272 00000100:00100000:3.0:1789127182.410347:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.410381:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276870016 00000100:00100000:3.0:1789127182.410385:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276870016 00000100:00100000:3.0:1789127182.410403:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276870144 00000100:00100000:3.0:1789127182.410405:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276870144 00000100:00100000:3.0:1789127182.410417:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127182.410425:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276870016:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789127182.410446:0:23453:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:3.0:1789127182.410484:0:23453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ec521 00000004:00100000:3.0:1789127182.410500:0:23453:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789127182.410505:0:23453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1789127182.410703:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127182.410712:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276870272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127182.410770:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276870272:12345-0@lo:400:kworker.0 Request processed in 60us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127182.410777:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789127182.410847:0:24185:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00010000:00080000:1.0:1789127182.410929:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99410501b480 x1876035276870272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127182.410942:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276870272:0@lo:400:kworker.0 00000040:01000000:2.0:1789127182.412146:0:24185:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789127182.412478:0:24185:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789127182.414340:0:24185:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127182.414566:0:24185:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00080000:0.0:1789127182.416467:0:23453:0:(import.c:65:import_set_state_nolock()) ffff99421226f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127182.416571:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1876035276870016:12345-0@lo:38:llog_process_th.0 Request processed in 6143us (7759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127182.416582:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1789127182.416690:0:24185:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1789127182.416832:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127182.416841:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789127182.416849:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789127182.416853:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789127182.416855:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994238d0e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789127182.416873:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276870016:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127182.417737:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127182.417747:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276870144:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789127182.417755:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127182.417772:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276870400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127182.417812:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1876035276870144:12345-0@lo:38:kworker.0 Request processed in 65us (7464us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789127182.417833:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127182.417842:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127182.417861:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276870400 00000100:00100000:0.0:1789127182.417867:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276870400 00000100:00100000:0.0:1789127182.417900:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127182.417907:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104063840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876035276870400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127182.417933:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789127182.418296:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127182.418304:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994220359800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127182.418308:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789127182.418312:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276870144:0@lo:38:kworker.0 00000100:00100000:0.0:1789127182.418531:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104063840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1876035276870400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 623us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127182.418538:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:3.0:1789127182.418752:0:24190:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789127182.418757:0:24190:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789127182.419265:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276870400:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1789127182.420040:0:24185:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789127182.420055:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789127182.420231:0:24185:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789127182.420262:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ec528 00000100:00080000:1.0:1789127182.420270:0:24185:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127182.420276:0:24185:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99422d6b9000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127182.420317:0:24185:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423664e580 x1876035276870528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127182.420345:0:24185:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1789127182.420562:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276870528:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789127182.420746:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127182.420751:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127182.420754:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127182.420757:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1789127182.421336:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127182.421344:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.421346:0:24185:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789127182.421353:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789127182.421356:0:24185:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789127182.421357:0:24185:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789127182.421359:0:24185:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789127182.421360:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789127182.421363:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.421365:0:24185:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789127182.421367:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789127182.421371:0:24185:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789127182.421374:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.421375:0:24185:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789127182.421379:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789127182.421382:0:24185:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.123@tcp to nid 0x20000c0a8cb7b (192.168.203.123@tcp) 00000020:01000000:1.0:1789127182.421404:0:24185:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000400:00000100:3.0:1789127182.421503:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276870528 offset 0 length 520: 4 00000020:00000080:1.0:1789127182.421580:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789127182.421729:0:24185:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9942313fced8) 00000020:00000080:1.0:1789127182.421748:0:24185:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789127182.421754:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789127182.421829:0:24185:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789127182.421836:0:24185:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789127182.421842:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xa840b4da666ec536 00010000:00080000:1.0:1789127182.421871:0:24185:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9941032b7800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1789127182.422584:0:24185:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789127182.422874:0:24185:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789127182.422892:0:24185:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789127182.426384:0:24185:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127182.426838:0:24185:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789127182.426950:0:24185:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1789127182.427940:0:24192:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789127182.427947:0:24192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789127182.429051:0:24185:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789127182.429073:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789127182.429126:0:24185:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789127182.429149:0:24185:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ec53d 00000100:00080000:2.0:1789127182.429161:0:24185:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127182.429236:0:24185:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9941032b7800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127182.429270:0:24185:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104062940 x1876035276870656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127182.429306:0:24185:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789127182.429346:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276870656:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789127182.429415:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276870656 offset 0 length 520: 4 00000020:01000000:2.0:1789127182.429431:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127182.429435:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.429437:0:24185:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789127182.429439:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127182.429443:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.429445:0:24185:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127182.429447:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127182.429449:0:24185:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789127182.429451:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127182.429458:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.429459:0:24185:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789127182.429462:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127182.429465:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.429466:0:24185:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789127182.429469:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789127182.429493:0:24185:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127182.429497:0:24185:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127182.429498:0:24185:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789127182.429501:0:24185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1789127182.429561:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127182.429566:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127182.429569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127182.429571:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1789127182.429616:0:24181:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789127182.429672:0:24181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789127182.429687:0:24181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3800/0xa840b4da666ec4bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec4c6 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.429698:0:24181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3800/0xa840b4da666ec4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec4c6 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127182.429707:0:24181:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99422043b000 from 1 10000000:01000000:3.0:1789127182.429710:0:24181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127182.429734:0:24181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.429742:0:24181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.429751:0:24181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127182.429766:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276870784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127182.429799:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.429818:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.429839:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276870784 00000100:00100000:1.0:1789127182.429845:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276870784 00000100:00100000:1.0:1789127182.429882:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127182.429891:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+15:24181:x1876035276870784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127182.429904:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127182.429916:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec544 expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.429939:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec544 expref: 16 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.429949:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec544 expref: 16 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.429957:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148fa00, rc 0) 00000100:00100000:1.0:1789127182.430010:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+16:24181:x1876035276870784:12345-0@lo:101:mount.lustre.0 Request processed in 112us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127182.430017:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127182.430091:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276870784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127182.430105:0:24181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.430114:0:24181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127182.430855:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276870912:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789127182.430886:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.431569:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276870912 00000100:00100000:3.0:1789127182.431576:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276870912 00000100:00100000:2.0:1789127182.431581:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.431624:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789127182.431634:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+16:24181:x1876035276870912:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789127182.431683:0:23439:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789127182.431739:0:23439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789127182.431742:0:23439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1789127182.431842:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+16:24181:x1876035276870912:12345-0@lo:256:mount.lustre.0 Request processed in 209us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.431850:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789127182.431853:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276870912:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789127182.432860:0:24181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127182.432875:0:24181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.432886:0:24181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127182.432894:0:24181:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99422043b000 from 1 10000000:01000000:2.0:1789127182.432904:0:24181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127182.432931:0:24181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.432939:0:24181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.432948:0:24181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127182.432965:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127182.433004:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.433366:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.433404:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276871040 00000100:00100000:1.0:1789127182.433410:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276871040 00000100:00100000:1.0:1789127182.433496:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127182.433506:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+16:24181:x1876035276871040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127182.433517:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127182.433529:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec552 expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.433550:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec552 expref: 17 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.433561:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec552 expref: 17 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.433568:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f200, rc 0) 00000100:00100000:1.0:1789127182.433626:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871040:12345-0@lo:101:mount.lustre.0 Request processed in 122us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127182.433633:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789127182.433740:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127182.433754:0:24181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.433763:0:24181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127182.434793:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000040:00080000:2.0:1789127182.435185:0:24181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127182.435361:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789127182.435382:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1789127182.435393:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1789127182.435543:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1789127182.435557:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1789127182.435567:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1789127182.435577:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1789127182.435586:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 144 off9680 00000040:00080000:2.0:1789127182.435599:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9904 00000040:00080000:2.0:1789127182.435624:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10128 00000040:00080000:2.0:1789127182.435639:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 144 off10272 00000040:00080000:2.0:1789127182.435694:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10496 00000040:00080000:2.0:1789127182.435709:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 224 off10720 00000040:00080000:2.0:1789127182.435722:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10848 00000040:00080000:2.0:1789127182.435736:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 224 off11072 00000040:00080000:2.0:1789127182.435748:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 224 off11296 00000040:00080000:2.0:1789127182.435759:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 128 off11424 00000040:00080000:2.0:1789127182.435773:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11648 00000040:00080000:2.0:1789127182.435777:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 18 count 19 00000100:00100000:2.0:1789127182.435843:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127182.435892:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.435935:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.436110:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276871168 00000100:00100000:3.0:1789127182.436117:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276871168 00000100:00100000:3.0:1789127182.436161:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789127182.436169:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127182.436275:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871168:12345-0@lo:501:mount.lustre.0 Request processed in 106us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.436297:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127182.436452:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127182.436483:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127182.436524:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.436623:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.436804:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276871296 00000100:00100000:1.0:1789127182.436809:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276871296 00000100:00100000:1.0:1789127182.436867:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127182.436875:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127182.436968:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871296:12345-0@lo:503:mount.lustre.0 Request processed in 93us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127182.436983:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127182.437056:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127182.437417:0:24181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127182.437485:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127182.437521:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.437985:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.438127:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276871424 00000100:00100000:3.0:1789127182.438133:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276871424 00000100:00100000:3.0:1789127182.438163:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789127182.438170:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871424:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127182.438266:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871424:12345-0@lo:502:mount.lustre.0 Request processed in 95us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.438273:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127182.438361:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127182.438550:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789127182.438579:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1789127182.438595:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1789127182.438609:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1789127182.438633:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1789127182.438684:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1789127182.438703:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1789127182.438718:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 144 off9680 00000040:00080000:2.0:1789127182.438733:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9904 00000040:00080000:2.0:1789127182.438748:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10128 00000040:00080000:2.0:1789127182.438761:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 144 off10272 00000040:00080000:2.0:1789127182.438774:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10496 00000040:00080000:2.0:1789127182.438788:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 224 off10720 00000040:00080000:2.0:1789127182.438802:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10848 00000040:00080000:2.0:1789127182.438819:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 224 off11072 00000040:00080000:2.0:1789127182.438849:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 224 off11296 00000040:00080000:2.0:1789127182.438866:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 128 off11424 00000100:00100000:2.0:1789127182.438895:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127182.438938:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.438960:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.439120:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276871552 00000100:00100000:3.0:1789127182.439125:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276871552 00000100:00100000:3.0:1789127182.439161:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789127182.439170:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127182.439251:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871552:12345-0@lo:502:mount.lustre.0 Request processed in 83us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.439258:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127182.439345:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127182.439383:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11648 00000040:00080000:2.0:1789127182.439391:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789127182.440566:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127182.440577:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440580:0:24194:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789127182.440596:0:24194:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99422043b000 00000020:00000080:1.0:1789127182.440599:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127182.440608:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127182.440617:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440619:0:24194:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789127182.440622:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127182.440625:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440626:0:24194:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127182.440630:0:24194:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99422043b000 00000020:00000080:1.0:1789127182.440632:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127182.440714:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127182.440718:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440719:0:24194:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789127182.440721:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127182.440724:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440726:0:24194:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127182.440729:0:24194:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99422043b000 00000020:00000080:1.0:1789127182.440732:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127182.440751:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127182.440754:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440755:0:24194:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127182.440758:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127182.440760:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440761:0:24194:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127182.440764:0:24194:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99422043b000 00000020:00000080:1.0:1789127182.440766:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127182.440781:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127182.440784:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440785:0:24194:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127182.440788:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127182.440791:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440792:0:24194:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127182.440795:0:24194:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99422043b000 00000020:00000080:1.0:1789127182.440797:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127182.440824:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127182.440827:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440832:0:24194:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127182.440835:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127182.440838:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440840:0:24194:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789127182.440843:0:24194:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99422043b000 00000020:00000080:1.0:1789127182.440845:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127182.440870:0:24194:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127182.440873:0:24194:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127182.440875:0:24194:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789127182.440877:0:24194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 19 count 19 00000020:01000000:2.0:1789127182.441834:0:24181:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789127182.441880:0:24181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127182.441901:0:24181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.441915:0:24181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127182.441996:0:24181:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789127182.442001:0:24181:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99422043b000 10000000:01000000:2.0:1789127182.442004:0:24181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99422043b000 10000000:01000000:2.0:1789127182.442016:0:24181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127182.442530:0:24181:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99422043b000 from 1 10000000:01000000:2.0:1789127182.442534:0:24181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127182.442569:0:24181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ec560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.442578:0:24181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ec560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.442588:0:24181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ec560 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127182.442613:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127182.442704:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.442747:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.442770:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276871680 00000100:00100000:1.0:1789127182.442779:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276871680 00000100:00100000:1.0:1789127182.442818:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789127182.442827:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:24181:x1876035276871680:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127182.442839:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127182.442852:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148ec00/0xa840b4da666ec567 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec560 expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.442875:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148ec00/0xa840b4da666ec567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec560 expref: 18 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.442886:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148ec00/0xa840b4da666ec567 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec560 expref: 18 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127182.442896:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148ec00, rc 0) 00000100:00100000:1.0:1789127182.442947:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24181:x1876035276871680:12345-0@lo:101:mount.lustre.0 Request processed in 121us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127182.442954:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789127182.443102:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127182.443118:0:24181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ec560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec567 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.443126:0:24181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ec560 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec567 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127182.450098:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1789127182.450387:0:24181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127182.450590:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1789127182.450615:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1789127182.450630:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1789127182.450644:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1789127182.450767:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1789127182.450779:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1789127182.450793:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1789127182.450809:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1789127182.450824:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1789127182.450839:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1789127182.450855:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1789127182.450868:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1789127182.450884:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1789127182.450898:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1789127182.450923:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1789127182.450936:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1789127182.450948:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1789127182.450959:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1789127182.450972:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1789127182.450984:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1789127182.451012:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1789127182.451025:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1789127182.451035:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1789127182.451046:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1789127182.451056:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1789127182.451066:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1789127182.451076:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1789127182.451087:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1789127182.451099:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1789127182.451113:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1789127182.451125:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1789127182.451136:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1789127182.451147:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1789127182.451160:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1789127182.452727:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1789127182.452752:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1789127182.452785:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1789127182.452804:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1789127182.452831:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1789127182.452851:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1789127182.452870:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1789127182.452887:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1789127182.452906:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1789127182.452923:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1789127182.452942:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1789127182.452964:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1789127182.452983:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1789127182.453012:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1789127182.454004:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1789127182.454038:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1789127182.454060:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1789127182.454065:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1789127182.454325:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127182.454395:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.454444:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.454824:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276871808 00000100:00100000:3.0:1789127182.454832:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276871808 00000100:00100000:3.0:1789127182.454878:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127182.454888:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24181:x1876035276871808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127182.455009:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24181:x1876035276871808:12345-0@lo:501:mount.lustre.0 Request processed in 122us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.455017:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789127182.455115:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127182.455148:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127182.455254:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.455279:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127182.455640:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276871936 00000100:00100000:3.0:1789127182.455674:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276871936 00000100:00100000:3.0:1789127182.455713:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789127182.455849:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24181:x1876035276871936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127182.455943:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24181:x1876035276871936:12345-0@lo:503:mount.lustre.0 Request processed in 97us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127182.456027:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276871936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127182.456466:0:24181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127182.456550:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276872064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127182.456593:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.456623:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698540 going to sleep for 11 seconds 00000100:00100000:2.0:1789127182.456640:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276872064 00000100:00100000:2.0:1789127182.456644:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276872064 00000100:00100000:2.0:1789127182.456690:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789127182.456698:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24181:x1876035276872064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127182.456792:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24181:x1876035276872064:12345-0@lo:502:mount.lustre.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127182.456800:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789127182.456845:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276872064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127182.457007:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1789127182.457042:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1789127182.457061:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1789127182.457078:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1789127182.457098:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1789127182.457118:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1789127182.457133:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1789127182.457150:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1789127182.457167:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1789127182.457184:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1789127182.457203:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1789127182.457217:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1789127182.457231:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1789127182.457246:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1789127182.457275:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1789127182.457310:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1789127182.457326:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1789127182.457338:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1789127182.457350:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1789127182.457364:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1789127182.457378:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1789127182.457391:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1789127182.457405:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1789127182.457421:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1789127182.457437:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1789127182.457453:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1789127182.457470:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1789127182.457486:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1789127182.457501:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1789127182.457515:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1789127182.457542:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1789127182.457560:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1789127182.457576:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1789127182.457591:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1789127182.457617:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1789127182.457633:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1789127182.457675:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1789127182.457696:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1789127182.457713:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1789127182.457747:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1789127182.457764:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1789127182.457781:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1789127182.457799:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1789127182.457816:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1789127182.457832:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1789127182.457847:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1789127182.457876:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1789127182.457896:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1789127182.457938:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276872192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127182.457993:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.458037:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276872192 00000100:00100000:2.0:1789127182.458042:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276872192 00000100:00100000:2.0:1789127182.458078:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789127182.458087:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24181:x1876035276872192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127182.458176:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24181:x1876035276872192:12345-0@lo:502:mount.lustre.0 Request processed in 90us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127182.458185:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789127182.458232:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698540 going to sleep for 11 seconds 00000100:00100000:2.0:1789127182.458251:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276872192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127182.458407:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1789127182.458433:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1789127182.458455:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276872320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127182.458497:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.458518:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276872320 00000100:00100000:2.0:1789127182.458521:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276872320 00000100:00100000:2.0:1789127182.458545:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127182.458552:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24181:x1876035276872320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127182.458609:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24181:x1876035276872320:12345-0@lo:502:mount.lustre.0 Request processed in 57us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127182.458616:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127182.458681:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff994229698540 going to sleep for 11 seconds 00000100:00100000:2.0:1789127182.458712:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276872320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127182.458749:0:24181:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1789127182.458757:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:3.0:1789127182.459878:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000020:01000004:2.0:1789127182.460424:0:24199:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789127182.460440:0:24199:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff99423d000000) 00000020:00000080:2.0:1789127182.460616:0:24199:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789127182.460836:0:24199:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99422043b000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789127182.460841:0:24199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99422043b000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789127182.460843:0:24199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99422043b000 3 00010000:00080000:2.0:1789127182.460873:0:24199:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994238d0b800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1789127182.463338:0:24199:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789127182.463746:0:24199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789127182.463789:0:24199:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127182.463804:0:24199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xa840b4da666ec575 00000100:00080000:2.0:1789127182.463815:0:24199:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127182.463821:0:24199:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff994238d0b800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127182.463857:0:24199:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941040630c0 x1876035276872448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127182.463910:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276872448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127182.463979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.464040:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276872448 00000100:00100000:2.0:1789127182.464046:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276872448 00000100:00100000:2.0:1789127182.464077:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127182.464084:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1876035276872448:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127182.464106:0:23449:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 607 last 0 00000020:00000080:2.0:1789127182.464134:0:23449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa840b4da666ec57c 00000004:00100000:2.0:1789127182.464150:0:23449:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127182.464248:0:23449:0:(import.c:65:import_set_state_nolock()) ffff9941040c3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127182.464312:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876035276872448:12345-0@lo:38:llog_process_th.0 Request processed in 226us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127182.464320:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789127182.464358:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9941040630c0 x1876035276872448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127182.464368:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127182.464375:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789127182.464381:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789127182.464385:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127182.464387:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994238d0b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127182.464393:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876035276872448:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789127182.464414:0:24199:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789127182.464438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127182.464443:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127182.464613:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127182.464618:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1789127182.464896:0:24199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1789127182.466105:0:24181:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789127182.466145:0:24181:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127182.467257:0:24181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ec560 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec567 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127182.467271:0:24181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236588600/0xa840b4da666ec560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec567 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127182.467350:0:24181:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789127182.467353:0:24181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127182.467355:0:24181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127182.467356:0:24181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127182.467357:0:24181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127182.467359:0:24181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127182.467360:0:24181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127182.467362:0:24181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127182.467364:0:24181:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127182.467368:0:24181:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1789127182.467371:0:24181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127182.467372:0:24181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127182.467373:0:24181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127182.467375:0:24181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127182.467376:0:24181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127182.467377:0:24181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127182.467379:0:24181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127182.467380:0:24181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127182.467381:0:24181:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127182.467590:0:24181:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789127182.467613:0:24181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276872576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127182.467751:0:24181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127182.467798:0:24181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127182.468973:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276872576 00000100:00100000:2.0:1789127182.468982:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276872576 00000100:00100000:2.0:1789127182.469033:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789127182.469042:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24181:x1876035276872576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789127182.469072:0:23439:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789127182.469088:0:23439:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789127182.474594:0:23427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789127182.475027:0:23439:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789127182.475045:0:23439:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789127182.475309:0:23463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789127182.475315:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789127182.475339:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.475356:0:23463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec480 expref: 18 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.475452:0:23463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec544 expref: 18 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.475459:0:23463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.475500:0:23463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec544 expref: 18 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.475515:0:23463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec544 expref: 18 pid: 23441 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127182.475532:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276872704:0@lo:104: 00000100:00100000:0.0:1789127182.476059:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127182.476135:0:23463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec480 expref: 18 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.476146:0:23463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec480 expref: 18 pid: 23439 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127182.476233:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276872832:0@lo:104: 00000100:00100000:0.0:1789127182.476267:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127182.476303:0:23463:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127182.476346:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276872704 00000100:00100000:0.0:1789127182.476353:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276872704 00000100:00100000:0.0:1789127182.476464:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276872832 00000100:00100000:0.0:1789127182.476469:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276872832 00000100:00100000:0.0:1789127182.476486:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127182.476494:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+4:23463:x1876035276872704:12345-0@lo:104: 00010000:00010000:0.0:1789127182.476515:0:23431:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.476577:0:23431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127182.476584:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+4:23463:x1876035276872704:12345-0@lo:104: Request processed in 91us (528us total) trans 0 rc 0/0 00010000:00010000:2.0:1789127182.476590:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789127182.476593:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789127182.476600:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.476610:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc132ec20) 00000100:00100000:0.0:1789127182.476614:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 10000000:00010000:2.0:1789127182.476616:0:23436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127182.476624:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276872832:12345-0@lo:104: 00010000:00010000:2.0:1789127182.476629:0:23436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.476634:0:23431:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127182.476638:0:23436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127182.476670:0:23436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127182.476697:0:23431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127182.476703:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276872832:12345-0@lo:104: Request processed in 83us (437us total) trans 0 rc 0/0 00010000:00010000:2.0:1789127182.476704:0:23436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.476728:0:23436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127182.476748:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.476755:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec54b expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.476767:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127182.476771:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.476777:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789127182.476780:0:23436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.476787:0:23436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127182.476791:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:00010000:2.0:1789127182.476799:0:23436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127182.476805:0:23436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127182.476818:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127182.476819:0:23436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.476827:0:23436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127182.476843:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127182.476845:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276872704:0@lo:104: 00010000:00010000:2.0:1789127182.476856:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236588400/0xa840b4da666ec480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec487 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127182.476860:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276872832:0@lo:104: 00010000:00010000:2.0:1789127182.476885:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127182.476887:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127182.476890:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127182.476890:0:23463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127182.476915:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276872960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127182.476949:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127182.477006:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276873088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127182.477023:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276872960 00000100:00100000:0.0:1789127182.477028:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276872960 00000100:00100000:2.0:1789127182.477035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127182.477050:0:23432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec544 expref: 19 pid: 23441 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127182.477077:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276873088 00000100:00100000:0.0:1789127182.477086:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276873088 00000100:00100000:2.0:1789127182.477093:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789127182.477101:0:23432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec480 expref: 20 pid: 23439 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127182.477104:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104062580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:3642:x1876035276872960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127182.477120:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127182.477127:0:23433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec544 expref: 20 pid: 23441 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127182.477135:0:23432:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789127182.477140:0:23433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec544 expref: 20 pid: 23441 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127182.477145:0:23432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789127182.477159:0:23433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148fa00/0xa840b4da666ec54b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec544 expref: 20 pid: 23441 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127182.477171:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127182.477242:0:23434:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789127182.477252:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127182.477259:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:3639:x1876035276873088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127182.477267:0:23434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127182.477272:0:23434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec480 expref: 19 pid: 23439 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477293:0:23434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec480 expref: 19 pid: 23439 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477304:0:23434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236588c00/0xa840b4da666ec487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec480 expref: 19 pid: 23439 timeout: 707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477315:0:23434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477323:0:23434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789127182.477335:0:23434:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006293340s 00010000:00010000:0.0:1789127182.477340:0:23434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477346:0:23434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127182.477444:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104062580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:3642:x1876035276872960:12345-0@lo:103:ldlm_bl.0 Request processed in 343us (494us total) trans 0 rc 0/0 00010000:00010000:0.0:1789127182.477471:0:23434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477480:0:23434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477485:0:23434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127182.477489:0:23434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477495:0:23434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477508:0:23434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477517:0:23434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127182.477548:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040621c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:3639:x1876035276873088:12345-0@lo:103:ldlm_bl.0 Request processed in 289us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127182.477556:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127182.477568:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789127182.477593:0:23463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477602:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127182.477610:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb800/0xa840b4da666ec583 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127182.477686:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276873088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127182.477715:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276872960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127182.479363:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+16:24181:x1876035276872576:12345-0@lo:253:mount.lustre.0 Request processed in 10316us (11606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127182.479375:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127182.479575:0:24181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24181:1876035276872576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789127182.479597:0:24181:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789127182.479601:0:24181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789127182.479603:0:24181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127182.479604:0:24181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127182.479606:0:24181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127182.479607:0:24181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127182.479609:0:24181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127182.479610:0:24181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127182.479612:0:24181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127182.479614:0:24181:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789127182.479631:0:24181:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1789127182.488399:0:24181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789127182.488557:0:24208:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789127182.488567:0:24208:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789127182.491321:0:24209:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789127182.492218:0:24181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789127182.492763:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24211:1876035276873216:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.492840:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127182.492894:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276873216 00000100:00100000:1.0:1789127182.492901:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276873216 00000100:00100000:1.0:1789127182.492947:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127182.492956:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24211:x1876035276873216:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.493030:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24211:x1876035276873216:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127182.493037:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127182.493065:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff994203393600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.493089:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24211:1876035276873216:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789127182.493119:0:24211:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789127182.493146:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24211:1876035276873344:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.493176:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1789127182.493487:0:24181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789127182.493524:0:24181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127182.493638:0:24209:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789127182.494849:0:24181:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789127182.494861:0:24181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1789127182.494937:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276873344 00000100:00100000:1.0:1789127182.494944:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276873344 00000100:00100000:1.0:1789127182.494996:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127182.495006:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24211:x1876035276873344:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.495153:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24211:x1876035276873344:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 149us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127182.495160:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:00080000:2.0:1789127182.495255:0:24181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127182.495389:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff994203393600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.495419:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24211:1876035276873344:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.497842:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24211:1876035276873472:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.497929:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127182.498088:0:23458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276873472 00000100:00100000:1.0:1789127182.498102:0:23458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276873472 00000100:00100000:1.0:1789127182.498153:0:23458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127182.498167:0:23458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24211:x1876035276873472:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.498227:0:23458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24211:x1876035276873472:12345-0@lo:900:lod0001_rec0000.0 Request processed in 66us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127182.498235:0:23458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127182.498259:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff994203393f00 going to sleep for 11 seconds 00010000:00080000:1.0:1789127182.498280:0:24211:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99423664f480 x1876035276873472/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127198 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127182.498302:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24211:1876035276873472:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.498353:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24211:1876035276873600:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.498392:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127182.498415:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276873600 00000100:00100000:1.0:1789127182.498419:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276873600 00000100:00100000:1.0:1789127182.498442:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127182.498448:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24211:x1876035276873600:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789127182.498501:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24211:x1876035276873600:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127182.498508:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127182.498526:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff994203393600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127182.498539:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24211:1876035276873600:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789127182.498577:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127182.500606:0:24181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789127182.501184:0:24181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789127182.501229:0:24181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789127182.501425:0:24181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789127182.502001:0:24181:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:0.0:1789127182.503517:0:24209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789127182.503582:0:24209:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00010000:0.0:1789127182.507296:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127182.509071:0:24211:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789127182.509147:0:24211:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789127182.509152:0:24211:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1789127182.509517:0:24181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789127182.513984:0:24181:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789127182.514042:0:24181:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb3054188b988 00100000:10000000:1.0:1789127182.514051:0:24181:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789127182.514545:0:24181:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789127182.514574:0:24181:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789127182.514592:0:24181:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789127182.514613:0:24181:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789127182.515479:0:24181:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127182.515745:0:24181:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789127182.826816:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000040:00080000:0.0:1789127182.827478:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127183.530834:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789127183.530898:0:23444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127183.530902:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99422043b000 from 12 10000000:01000000:3.0:1789127183.530907:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127183.531021:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127183.531032:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127183.531043:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127183.531067:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276873728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127183.531149:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789127183.531482:0:24206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789127183.531692:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127183.531763:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276873728 00000100:00100000:2.0:1789127183.531770:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276873728 00000100:00100000:2.0:1789127183.531812:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789127183.531821:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+16:23444:x1876035276873728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127183.531833:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127183.531847:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec58a expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127183.531869:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec58a expref: 17 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127183.531879:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec58a expref: 17 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127183.531888:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589e00, rc 0) 00000100:00100000:2.0:1789127183.531939:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276873728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127183.532026:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127183.532119:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276873728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127183.532907:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127183.532920:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127183.533059:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276873856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127183.533967:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127183.534017:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127183.534164:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276873856 00000100:00100000:2.0:1789127183.534170:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276873856 00000100:00100000:2.0:1789127183.534232:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789127183.534241:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276873856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789127183.534259:0:23439:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127183.534293:0:23439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127183.534296:0:23439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789127183.534772:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276873856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 531us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127183.534780:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789127183.534863:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276873856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789127183.534911:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127183.534919:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127183.534929:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127183.534940:0:23444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127183.534942:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994103e26000 from 12 10000000:01000000:3.0:1789127183.534944:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127183.534981:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127183.534988:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127183.534996:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127183.535014:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276873984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127183.535040:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127183.535071:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127183.535175:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276873984 00000100:00100000:2.0:1789127183.535179:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276873984 00000100:00100000:2.0:1789127183.535224:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127183.535232:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276873984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127183.535241:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127183.535254:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec598 expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127183.535619:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec598 expref: 18 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127183.535633:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec598 expref: 18 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127183.535642:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994236589c00, rc 0) 00000100:00100000:2.0:1789127183.535756:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:23444:x1876035276873984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 524us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127183.535774:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789127183.536625:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276873984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127183.536756:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127183.536767:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127183.536827:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276874112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127183.536871:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127183.536968:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127183.539914:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276874112 00000100:00100000:2.0:1789127183.539928:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276874112 00000100:00100000:2.0:1789127183.540045:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127183.540066:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:23444:x1876035276874112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789127183.540091:0:23439:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127183.540115:0:23439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127183.540118:0:23439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789127183.540260:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:23444:x1876035276874112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (3386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127183.540269:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789127183.540857:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276874112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789127183.540922:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127183.540932:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127183.540942:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127183.853826:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789127184.554816:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127184.555387:0:24206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127184.874730:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789127185.578888:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127185.901454:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000001:02000400:3.0:1789127186.483398:0:24455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789127186.606784:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127186.922750:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 0 seconds 00000020:00000004:3.0:1789127187.381529:0:24507:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127187.381776:0:24507:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1789127187.629442:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789127187.629448:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789127187.629452:0:8:0:(import.c:65:import_set_state_nolock()) ffff994220359800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127187.629463:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff994220359800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127187.629485:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104061a40 x1876035276874368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127187.629500:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127187.629504:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127187.629507:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127187.629510:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127187.629533:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127187.629536:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127187.629544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127187.629547:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127187.629620:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3640:1876035276874240:0@lo:400:kworker.0 00000100:00100000:2.0:1789127187.629696:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127187.629743:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127187.629749:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276874752:0@lo:400:kworker.0 00000100:00100000:2.0:1789127187.629770:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127187.629804:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276874368:0@lo:38:kworker.0 00000100:00100000:0.0:1789127187.629851:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276874752 00000100:00100000:0.0:1789127187.629860:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276874752 00000100:00100000:0.0:1789127187.629906:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127187.629915:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276874752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127187.629981:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276874752:12345-0@lo:400:kworker.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127187.629989:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127187.630164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127187.630204:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127187.630220:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276874880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127187.630232:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276874496:0@lo:400:kworker.0 00000100:00100000:0.0:1789127187.630282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127187.630288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127187.630308:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127187.630314:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276874624:0@lo:400:kworker.0 00010000:00010000:2.0:1789127187.630341:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127187.630352:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276874240 00000100:00100000:2.0:1789127187.630356:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276874240 00000100:00100000:2.0:1789127187.630384:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789127187.630391:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994204959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:3640:x1876035276874240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127187.630420:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994204959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:3640:x1876035276874240:12345-0@lo:400:kworker.0 Request processed in 30us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127187.630426:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789127187.630448:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276874496 00000100:00100000:2.0:1789127187.630451:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276874496 00000100:00100000:2.0:1789127187.630468:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127187.630473:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276874496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127187.630511:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276874496:12345-0@lo:400:kworker.0 Request processed in 37us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127187.630517:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789127187.630544:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994104061680 x1876035276874752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127187.630555:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276874752:0@lo:400:kworker.0 00000100:00100000:2.0:1789127187.630563:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3640:1876035276874240:0@lo:400:kworker.0 00000100:00100000:3.0:1789127187.643373:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276874368 00000100:00100000:3.0:1789127187.643389:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276874368 00000100:00100000:3.0:1789127187.644301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789127187.644365:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994104063480 x1876035276874496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127187.644381:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276874496:0@lo:400:kworker.0 00000100:00100000:3.0:1789127187.645833:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276874880 00000100:00100000:3.0:1789127187.645842:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276874880 00000100:00100000:3.0:1789127187.645864:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276874624 00000100:00100000:3.0:1789127187.645867:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276874624 00000100:00100000:3.0:1789127187.645882:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127187.645891:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1876035276874368:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789127187.645924:0:23452:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:3.0:1789127187.645976:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ec5a6 00000004:00100000:3.0:1789127187.645993:0:23452:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789127187.646008:0:23452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1789127187.663852:0:23452:0:(import.c:65:import_set_state_nolock()) ffff9942364b9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127187.664050:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876035276874368:12345-0@lo:38:kworker.0 Request processed in 18157us (34220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127187.664065:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127187.664113:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127187.664126:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1876035276874880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127187.664163:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789127187.664227:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1876035276874880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (33945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127187.664234:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127187.664260:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127187.664267:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276874624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127187.664311:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276874624:12345-0@lo:400:kworker.0 Request processed in 44us (20014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127187.664317:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127187.664500:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276874624:0@lo:400:kworker.0 00000100:00100000:1.0:1789127187.664794:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276874880:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789127187.665018:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789127187.665031:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789127187.665038:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789127187.665042:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994220359800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789127187.665104:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000039920c45): req@ffff994105018b40 x1876035276867456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127187.665130:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276874368:0@lo:38:kworker.0 00000100:00100000:3.0:1789127187.665274:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127187.665312:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942051d83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127187.665382:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276867456 00000100:00100000:0.0:1789127187.665399:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276867456 00000100:00100000:0.0:1789127187.665447:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127187.665455:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23491:x1876035276867456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789127187.665549:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23491:x1876035276867456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 95us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127187.665556:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127187.666020:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23491:1876035276867456:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789127187.666067:0:23491:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789127187.666123:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23491:1876035276875008:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789127187.666178:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127187.666200:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127187.666218:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276875008 00000100:00100000:3.0:1789127187.666222:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276875008 00000100:00100000:3.0:1789127187.666258:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127187.666267:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23491:x1876035276875008:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789127187.666602:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23491:x1876035276875008:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 335us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127187.666610:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127187.666783:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23491:1876035276875008:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789127187.666872:0:23491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23491:1876035276875136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789127187.666905:0:23491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127187.666930:0:23491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941031069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127187.666992:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276875136 00000100:00100000:3.0:1789127187.666997:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276875136 00000100:00100000:3.0:1789127187.667036:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127187.667043:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23491:x1876035276875136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789127187.667108:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23491:x1876035276875136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127187.667115:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127187.667335:0:23491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018780 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23491:1876035276875136:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1789127187.667409:0:23491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127187.669548:0:23491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789127187.669699:0:23491:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:0.0:1789127187.669704:0:23491:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1789127187.670634:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127187.670674:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276875264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127187.670762:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127187.671226:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276875264 00000100:00100000:3.0:1789127187.671236:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276875264 00000100:00100000:3.0:1789127187.671312:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127187.671323:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276875264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127187.671500:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127187.671594:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276875264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 272us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127187.671602:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127187.671697:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276875264:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1789127188.342143:0:24557:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127188.342990:0:24557:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789127188.650976:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789127189.177713:0:24605:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8c374180 20000000:00000080:2.0:1789127189.177739:0:24605:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994207b35400 uarg=0000000000000000 20000000:01000000:2.0:1789127189.177791:0:24605:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789127189.177800:0:24605:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789127189.177807:0:24605:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789127189.181378:0:24606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:3.0:1789127189.182591:0:24605:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789127189.190129:0:24605:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789127189.190159:0:24605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127189.190178:0:24605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec44f expref: 17 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127189.190186:0:24605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec552 expref: 17 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127189.190194:0:24605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127189.190233:0:24605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec552 expref: 17 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127189.190258:0:24605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec552 expref: 17 pid: 23441 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127189.190469:0:24605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24605:1876035276875392:0@lo:104: 00000100:00100000:3.0:1789127189.190529:0:24605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127189.190642:0:24605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec44f expref: 17 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127189.190685:0:24605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec44f expref: 17 pid: 23442 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127189.190708:0:24605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24605:1876035276875520:0@lo:104: 00000100:00100000:3.0:1789127189.190729:0:24605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127189.191131:0:24605:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127189.191195:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276875392 00000100:00100000:0.0:1789127189.191201:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276875392 00000100:00100000:0.0:1789127189.191248:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276875520 00000100:00100000:0.0:1789127189.191250:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276875520 00000100:00100000:0.0:1789127189.191264:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127189.191271:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+4:24605:x1876035276875392:12345-0@lo:104: 00010000:00010000:0.0:1789127189.191293:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191352:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127189.191358:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+4:24605:x1876035276875392:12345-0@lo:104: Request processed in 87us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127189.191381:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127189.191403:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127189.191417:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:24605:x1876035276875520:12345-0@lo:104: 00010000:00010000:0.0:1789127189.191425:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191457:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127189.191462:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:24605:x1876035276875520:12345-0@lo:104: Request processed in 47us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127189.191468:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789127189.191483:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127189.191489:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191496:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589800 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127189.191499:0:23435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191508:0:23435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127189.191515:0:23435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127189.191521:0:23435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127189.191546:0:23435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191553:0:23435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127189.191576:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191583:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236589800/0xa840b4da666ec552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec559 expref: -99 pid: 24181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191598:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127189.191601:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191607:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364caa00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:0.0:1789127189.191610:0:23435:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191617:0:23435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127189.191623:0:23435:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127189.191629:0:23435:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127189.191640:0:23435:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191645:0:23435:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127189.191673:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191680:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364caa00/0xa840b4da666ec44f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec456 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191703:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127189.191705:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127189.191706:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127189.191725:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276875648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127189.191753:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127189.191782:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276875648 00000100:00100000:0.0:1789127189.191785:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276875648 00010000:00010000:0.0:1789127189.191801:0:23434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec552 expref: 18 pid: 23441 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127189.191820:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127189.191826:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:3642:x1876035276875648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127189.191835:0:23434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127189.191840:0:23434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec552 expref: 18 pid: 23441 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191849:0:23434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec552 expref: 18 pid: 23441 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.191866:0:23434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127189.191890:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:3642:x1876035276875648:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127189.191897:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127189.191927:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276875648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127189.192007:0:24605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148f200/0xa840b4da666ec559 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec552 expref: 17 pid: 23441 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127189.192018:0:24605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24605:1876035276875392:0@lo:104: 00000100:00100000:3.0:1789127189.192026:0:24605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24605:1876035276875520:0@lo:104: 00010000:00010000:3.0:1789127189.192041:0:24605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127189.192123:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276875776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127189.192147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127189.192230:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276875776 00000100:00100000:1.0:1789127189.192235:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276875776 00010000:00010000:1.0:1789127189.192264:0:24204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec44f expref: 17 pid: 23442 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127189.192284:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127189.192290:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:3639:x1876035276875776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127189.192298:0:24204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127189.192303:0:24204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec44f expref: 17 pid: 23442 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192311:0:24204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec44f expref: 17 pid: 23442 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192331:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2800/0xa840b4da666ec456 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec44f expref: 17 pid: 23442 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192341:0:24204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192347:0:24204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192359:0:24204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192365:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192371:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192377:0:24204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192382:0:24204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127189.192385:0:24204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192392:0:24204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192400:0:24204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127189.192414:0:24204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127189.192441:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+16:3639:x1876035276875776:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127189.192447:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127189.192471:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276875776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127189.192599:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127189.192835:0:24605:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127189.192842:0:24605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127189.192848:0:24605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3c00/0xa840b4da666ec5ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127189.674934:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127190.698815:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789127191.210810:0:23444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127191.210817:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99422043b000 from 19 10000000:01000000:3.0:1789127191.210821:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127191.210865:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127191.210877:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127191.210906:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127191.210933:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276875904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127191.210999:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127191.211043:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127191.211089:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276875904 00000100:00100000:0.0:1789127191.211096:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276875904 00000100:00100000:0.0:1789127191.211151:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127191.211160:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994204958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+16:23444:x1876035276875904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127191.211172:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127191.211186:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec5b4 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127191.211207:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec5b4 expref: 17 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127191.211217:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec5b4 expref: 17 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127191.211237:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb600, rc 0) 00000100:00100000:0.0:1789127191.211276:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994204958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276875904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127191.211283:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789127191.218362:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276875904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127191.218392:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127191.218404:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127191.218668:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127191.218733:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127191.218784:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127191.218838:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276876032 00000100:00100000:3.0:1789127191.218845:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276876032 00000100:00100000:3.0:1789127191.218898:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789127191.218908:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994204959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276876032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127191.219045:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994204959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276876032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127191.219054:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789127191.219105:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127191.219139:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127191.219183:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127191.219209:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127191.219257:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276876160 00000100:00100000:1.0:1789127191.219262:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276876160 00000100:00100000:1.0:1789127191.219297:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789127191.219315:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276876160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127191.219418:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276876160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127191.219427:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789127191.219438:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789127191.225038:0:24707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789127191.225403:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789127191.225436:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127191.225450:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127191.225482:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127191.225530:0:23444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127191.225535:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994103e26000 from 19 10000000:01000000:3.0:1789127191.225539:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127191.225582:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127191.225602:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127191.225613:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127191.225638:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127191.225719:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127191.225767:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127191.225778:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276876288 00000100:00100000:1.0:1789127191.225787:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276876288 00000100:00100000:1.0:1789127191.225838:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789127191.225849:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+17:23444:x1876035276876288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127191.225862:0:23442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127191.225873:0:23442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec5c2 expref: -99 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127191.225896:0:23442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec5c2 expref: 18 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127191.225906:0:23442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec5c2 expref: 18 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127191.225925:0:23442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148e200, rc 0) 00000100:00100000:1.0:1789127191.225974:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:23444:x1876035276876288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127191.225981:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789127191.226019:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127191.226035:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127191.226045:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127191.226106:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127191.230023:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127191.230079:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127191.232361:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276876416 00000100:00100000:0.0:1789127191.232375:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276876416 00000100:00100000:0.0:1789127191.232438:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789127191.232448:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:23444:x1876035276876416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127191.232639:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:23444:x1876035276876416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127191.232672:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789127191.232712:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127191.232770:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127191.232822:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127191.232851:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994208e45f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127191.232963:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276876544 00000100:00100000:0.0:1789127191.232969:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276876544 00000100:00100000:0.0:1789127191.232994:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789127191.233010:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:23444:x1876035276876544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127191.233098:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:23444:x1876035276876544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127191.233106:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789127191.233111:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276876544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789127191.236032:0:24709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789127191.236942:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789127191.236968:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127191.236979:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127191.236992:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127191.723183:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127192.045868:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1789127192.746864:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127192.746872:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127192.746875:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127192.746879:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127192.746895:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127192.746898:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127192.746901:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127192.746905:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127192.746985:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3640:1876035276876672:0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747075:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.747119:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276877184:0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.747180:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127192.747186:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276877056:0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.747255:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276876928:0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747281:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127192.747300:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127192.747305:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276876800:0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747326:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127192.747362:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127192.747382:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276876672 00000100:00100000:2.0:1789127192.747390:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276876672 00000100:00100000:2.0:1789127192.747445:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127192.747455:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:3640:x1876035276876672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747513:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:3640:x1876035276876672:12345-0@lo:400:kworker.0 Request processed in 59us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127192.747521:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127192.747560:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276877184 00000100:00100000:2.0:1789127192.747563:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276877184 00000100:00100000:2.0:1789127192.747591:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276876928 00000100:00100000:2.0:1789127192.747594:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276876928 00000100:00100000:2.0:1789127192.747608:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127192.747615:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276877184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747682:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276877184:12345-0@lo:400:kworker.0 Request processed in 67us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127192.747689:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127192.747701:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127192.747707:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276876928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747754:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276876928:12345-0@lo:400:kworker.0 Request processed in 47us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127192.747760:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127192.747782:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276877056 00000100:00100000:2.0:1789127192.747786:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276877056 00000100:00100000:2.0:1789127192.747805:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276876800 00000100:00100000:2.0:1789127192.747807:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276876800 00000100:00100000:2.0:1789127192.747821:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127192.747826:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276877056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747862:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276877056:12345-0@lo:400:kworker.0 Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127192.747868:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127192.747881:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127192.747886:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276876800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.747913:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276876800:12345-0@lo:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127192.747918:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127192.747971:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276876800:0@lo:400:kworker.0 00010000:00080000:2.0:1789127192.747987:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994104062d00 x1876035276876928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127192.747998:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276876928:0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.748036:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276877056:0@lo:400:kworker.0 00000100:00100000:2.0:1789127192.748044:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3640:1876035276876672:0@lo:400:kworker.0 00010000:00080000:2.0:1789127192.748054:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994104060b40 x1876035276877184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127192.748073:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276877184:0@lo:400:kworker.0 00000100:00100000:1.0:1789127192.749549:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127182/real 1789127182] req@ffff994104062940 x1876035276870656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127192.749582:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994104062940 x1876035276870656/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127192.749593:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127182/real 1789127182] req@ffff99423664e580 x1876035276870528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127192.749605:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99423664e580 x1876035276870528/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127192.749623:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127192.749640:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127192.749645:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276870656:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789127192.749665:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d6b9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127192.749671:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127192.749674:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276870528:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1789127192.749987:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127192.750003:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276877312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127192.750080:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127192.750132:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276877312 00000100:00100000:0.0:1789127192.750140:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276877312 00000100:00100000:0.0:1789127192.750191:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127192.750200:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276877312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127192.750253:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789127192.750307:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276877312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.750316:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789127192.752781:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127192.753605:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127192.753608:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127192.753612:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127192.753617:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127192.753620:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789127192.753624:0:470:0:(import.c:65:import_set_state_nolock()) ffff99422d6b9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127192.753634:0:470:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 607 00000100:00080000:2.0:1789127192.753641:0:470:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789127192.753677:0:470:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99422d6b9000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127192.753707:0:470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501e1c0 x1876035276877568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127192.753735:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127192.753739:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789127192.753741:0:470:0:(import.c:65:import_set_state_nolock()) ffff9941032b7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127192.753745:0:470:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 607 00000100:00080000:2.0:1789127192.753747:0:470:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789127192.753750:0:470:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9941032b7800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127192.753772:0:470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501c3c0 x1876035276877696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127192.753912:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276877440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127192.754000:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127192.754070:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276877312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127192.754112:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276877440 00000100:00100000:0.0:1789127192.754119:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276877440 00000100:00100000:0.0:1789127192.754163:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127192.754172:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941050192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276877440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127192.754209:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789127192.754269:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941050192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276877440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127192.754287:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127192.754322:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276877440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127192.757478:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276877568:0@lo:8:kworker.0 00000400:00000100:3.0:1789127192.757561:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276877568 offset 0 length 520: 4 00000100:00100000:3.0:1789127192.757719:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276877696:0@lo:8:kworker.0 00000400:00000100:3.0:1789127192.757741:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035276877696 offset 0 length 520: 4 00000001:00100000:1.0:1789127193.772485:0:24182:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789127193.775970:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789127194.798388:0:24206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127194.798508:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789127195.550143:0:24953:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789127195.550148:0:24953:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789127195.550150:0:24953:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789127195.550274:0:24953:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9942364bc800 00000020:01000004:3.0:1789127195.550291:0:24953:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789127195.550305:0:24953:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789127195.550319:0:24953:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff994212211a48) 00000020:00000080:3.0:1789127195.550335:0:24953:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789127195.637170:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789127195.644455:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789127195.645010:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789127195.645215:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789127195.645703:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789127195.645985:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789127195.646358:0:24953:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1789127195.649084:0:24953:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789127195.649398:0:24953:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789127195.649415:0:24953:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789127195.649430:0:24953:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa840b4da666ec5d7 00000020:01000004:2.0:1789127195.649439:0:24953:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789127195.649467:0:24953:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789127195.649471:0:24953:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789127195.649479:0:24953:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789127195.649485:0:24953:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789127195.649499:0:24953:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99423d004ed8) 00000020:00000080:2.0:1789127195.649511:0:24953:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789127195.654709:0:24953:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127195.654906:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789127195.654913:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789127195.658972:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127195.658990:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789127195.659519:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789127195.659527:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789127195.669452:0:24953:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127195.669632:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789127195.669639:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789127195.671101:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789127195.671110:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789127195.697103:0:24953:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127195.697360:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789127195.697366:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789127195.701010:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127195.701023:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789127195.704373:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789127195.704391:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789127195.709926:0:24953:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127195.710114:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789127195.710120:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789127195.711228:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789127195.711235:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789127195.748126:0:24953:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127195.748598:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789127195.748604:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789127195.749580:0:24953:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789127195.749589:0:24953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789127195.752015:0:24953:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789127195.752054:0:24953:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789127195.752062:0:24953:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789127195.764109:0:24953:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789127195.764146:0:24953:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.123@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789127195.764151:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789127195.764153:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127195.764154:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127195.764156:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127195.764157:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127195.764159:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127195.764160:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127195.764162:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127195.764164:0:24953:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127195.764167:0:24953:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789127195.764170:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789127195.764171:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127195.764172:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127195.764173:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127195.764175:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127195.764176:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127195.764177:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127195.764178:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127195.764179:0:24953:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127195.764224:0:24953:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789127195.764243:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276877824:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789127195.764312:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.764358:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422055e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.764428:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276877824 00000100:00100000:1.0:1789127195.764436:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276877824 00000100:00100000:1.0:1789127195.764494:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789127195.764504:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24953:x1876035276877824:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789127195.764535:0:23442:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789127195.764538:0:23442:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789127195.764542:0:23442:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789127195.764861:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24953:x1876035276877824:12345-0@lo:253:mount.lustre.0 Request processed in 357us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.764870:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789127195.764947:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276877824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789127195.764956:0:24953:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789127195.764958:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127195.764965:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127195.764967:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127195.764968:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127195.764969:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127195.764970:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127195.764971:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127195.764972:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127195.764973:0:24953:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789127195.764990:0:24953:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9942364bc800 from lustre-OST0000 10000000:01000000:2.0:1789127195.765019:0:24953:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789127195.765022:0:24953:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789127195.765029:0:24953:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9942290f1a48 local copy 00010000:00010000:2.0:1789127195.765038:0:24953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127195.765106:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276877952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127195.765134:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.765166:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422055ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.765227:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276877952 00000100:00100000:0.0:1789127195.765232:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276877952 00000100:00100000:0.0:1789127195.765264:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789127195.765271:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24953:x1876035276877952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127195.765348:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24953:x1876035276877952:12345-0@lo:501:mount.lustre.0 Request processed in 77us (214us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127195.765356:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789127195.765457:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276877952:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789127195.765469:0:24953:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789127195.765487:0:24953:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789127195.765493:0:24953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.765501:0:24953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127195.765523:0:24953:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9942364bc800 10000000:01000000:3.0:1789127195.765527:0:24953:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789127195.765532:0:24953:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789127195.765535:0:24953:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127195.765546:0:24953:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789127195.765550:0:24953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789127195.765570:0:24953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ec5e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.765578:0:24953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ec5e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.765587:0:24953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ec5e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127195.765601:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127195.765629:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.765678:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942012ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.765768:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276878080 00000100:00100000:1.0:1789127195.765772:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276878080 00000100:00100000:1.0:1789127195.765798:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789127195.765804:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+18:24953:x1876035276878080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127195.765813:0:23442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127195.765825:0:23442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148fa00/0xa840b4da666ec5ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec5e5 expref: -99 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.765845:0:23442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148fa00/0xa840b4da666ec5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec5e5 expref: 19 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.765855:0:23442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148fa00/0xa840b4da666ec5ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec5e5 expref: 19 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.765864:0:23442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148fa00, rc 0) 00000100:00100000:1.0:1789127195.765900:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878080:12345-0@lo:101:mount.lustre.0 Request processed in 97us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.765917:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789127195.766039:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127195.766051:0:24953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ec5e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec5ec expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.766060:0:24953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ec5e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec5ec expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127195.767044:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1789127195.767598:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127195.769274:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789127195.769311:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789127195.769386:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789127195.769411:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789127195.769423:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789127195.769433:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789127195.769444:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789127195.769461:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789127195.769472:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1789127195.769482:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1789127195.769493:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1789127195.769503:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1789127195.769522:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1789127195.769527:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1789127195.769613:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127195.769946:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.770021:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994210d4c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.770056:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276878208 00000100:00100000:0.0:1789127195.770062:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276878208 00000100:00100000:0.0:1789127195.770136:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127195.770144:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127195.770290:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878208:12345-0@lo:501:mount.lustre.0 Request processed in 146us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.770298:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789127195.770371:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127195.770406:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127195.770452:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.770637:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422055e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.770720:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276878336 00000100:00100000:1.0:1789127195.770725:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276878336 00000100:00100000:0.0:1789127195.770788:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127195.770796:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878336:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127195.771441:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878336:12345-0@lo:503:mount.lustre.0 Request processed in 644us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.771448:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789127195.771531:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878336:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127195.771937:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127195.772014:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127195.772053:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.774645:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422055e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127195.774709:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276878464 00000100:00100000:3.0:1789127195.774717:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276878464 00000100:00100000:3.0:1789127195.774768:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789127195.774786:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127195.775404:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127195.775644:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789127195.775742:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789127195.775758:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789127195.775772:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789127195.775787:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789127195.775800:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789127195.775813:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789127195.775826:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789127195.775839:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1789127195.775852:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1789127195.775865:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1789127195.775878:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1789127195.775909:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127195.775957:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.775978:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff99422055e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127195.776065:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878464:12345-0@lo:502:mount.lustre.0 Request processed in 1288us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127195.776074:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789127195.776112:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276878592 00000100:00100000:3.0:1789127195.776116:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276878592 00000100:00100000:3.0:1789127195.776137:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789127195.776144:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127195.776241:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878592:12345-0@lo:502:mount.lustre.0 Request processed in 96us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127195.776248:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789127195.776426:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127195.776465:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1789127195.776473:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789127195.777238:0:24970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789127195.777246:0:24970:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789127195.777253:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127195.777255:0:24970:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789127195.777261:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127195.777275:0:24970:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99423d001a48) 00000020:00000080:2.0:1789127195.777298:0:24970:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789127195.777304:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789127195.777451:0:24970:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9942364bc800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789127195.777459:0:24970:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789127195.777467:0:24970:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa840b4da666ec5fa 00010000:00010000:2.0:1789127195.781931:0:24970:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789127195.782358:0:24970:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1789127195.786021:0:24970:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:2.0:1789127195.788051:0:24970:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789127195.788062:0:24970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127195.788069:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127195.788071:0:24970:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789127195.788075:0:24970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789127195.788078:0:24970:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789127195.788080:0:24970:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127195.788082:0:24970:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127195.788083:0:24970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789127195.788086:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127195.788088:0:24970:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789127195.788090:0:24970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127195.788093:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127195.788095:0:24970:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127195.788098:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127195.788100:0:24970:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789127195.788102:0:24970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127195.788104:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127195.788106:0:24970:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789127195.788108:0:24970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127195.788111:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127195.788112:0:24970:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789127195.788115:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789127195.788134:0:24970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127195.788136:0:24970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127195.788137:0:24970:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789127195.788140:0:24970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1789127195.788434:0:24953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789127195.788466:0:24953:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789127195.788489:0:24953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ec5e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec5ec expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.788501:0:24953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3200/0xa840b4da666ec5e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec5ec expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127195.788509:0:24953:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9942364bc800 from 1 10000000:01000000:0.0:1789127195.788511:0:24953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127195.788547:0:24953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.788554:0:24953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.788565:0:24953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127195.788589:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127195.788693:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.788730:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941040b4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.788904:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276878720 00000100:00100000:1.0:1789127195.788911:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276878720 00000100:00100000:1.0:1789127195.788959:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789127195.788968:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:24953:x1876035276878720:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127195.788980:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127195.788993:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec601 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.789013:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec601 expref: 20 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.789022:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec601 expref: 20 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127195.789030:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f000, rc 0) 00000100:00100000:1.0:1789127195.789077:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276878720:12345-0@lo:101:mount.lustre.0 Request processed in 109us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.789083:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789127195.789206:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127195.789221:0:24953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.789241:0:24953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127195.790148:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:2.0:1789127195.790453:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127195.790601:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789127195.790627:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789127195.790641:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789127195.790697:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789127195.790712:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789127195.790723:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789127195.790735:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789127195.790747:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:2.0:1789127195.790759:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:2.0:1789127195.790771:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:2.0:1789127195.791399:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:2.0:1789127195.791421:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:2.0:1789127195.791435:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:2.0:1789127195.791448:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:2.0:1789127195.791462:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:2.0:1789127195.791475:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:2.0:1789127195.791487:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:2.0:1789127195.791505:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:2.0:1789127195.791511:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:2.0:1789127195.791586:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127195.791643:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.793306:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103106e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.796737:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276878848 00000100:00100000:0.0:1789127195.796749:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276878848 00000100:00100000:0.0:1789127195.796811:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789127195.796820:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276878848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127195.796971:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276878848:12345-0@lo:501:mount.lustre.0 Request processed in 151us (5326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.796979:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127195.797399:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127195.797445:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127195.797492:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.797517:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103106e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.797689:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276878976 00000100:00100000:0.0:1789127195.797694:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276878976 00000100:00100000:0.0:1789127195.797721:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789127195.797727:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276878976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127195.797818:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276878976:12345-0@lo:503:mount.lustre.0 Request processed in 90us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.797826:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789127195.798004:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276878976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127195.798465:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127195.798544:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127195.798582:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.798613:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103106480 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.798867:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276879104 00000100:00100000:1.0:1789127195.798873:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276879104 00000100:00100000:1.0:1789127195.798909:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789127195.798916:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276879104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127195.799002:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276879104:12345-0@lo:502:mount.lustre.0 Request processed in 85us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.799009:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789127195.799116:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127195.799284:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789127195.799309:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789127195.799391:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789127195.799408:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789127195.799422:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789127195.799435:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789127195.799448:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789127195.799460:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:2.0:1789127195.799472:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:2.0:1789127195.799485:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:2.0:1789127195.799498:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:2.0:1789127195.799511:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:2.0:1789127195.799525:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:2.0:1789127195.799538:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:2.0:1789127195.799562:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:2.0:1789127195.799576:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:2.0:1789127195.799588:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:2.0:1789127195.799612:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127195.799722:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.799747:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103106480 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.799854:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276879232 00000100:00100000:1.0:1789127195.799859:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276879232 00000100:00100000:1.0:1789127195.799928:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789127195.799935:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276879232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127195.800015:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276879232:12345-0@lo:502:mount.lustre.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.800022:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789127195.800084:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127195.800121:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:2.0:1789127195.800129:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:3.0:1789127195.801144:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127195.801153:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801155:0:24974:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789127195.801162:0:24974:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9942364bc800 00000020:00000080:3.0:1789127195.801165:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127195.801173:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127195.801175:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801183:0:24974:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789127195.801187:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127195.801202:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801204:0:24974:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789127195.801209:0:24974:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9942364bc800 00000020:00000080:3.0:1789127195.801211:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127195.801266:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127195.801270:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801271:0:24974:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789127195.801274:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127195.801276:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801277:0:24974:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127195.801280:0:24974:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9942364bc800 00000020:00000080:3.0:1789127195.801283:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127195.801299:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127195.801301:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801303:0:24974:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127195.801305:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127195.801308:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801309:0:24974:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127195.801319:0:24974:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9942364bc800 00000020:00000080:3.0:1789127195.801322:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127195.801338:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127195.801340:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801341:0:24974:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127195.801344:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127195.801346:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801348:0:24974:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127195.801351:0:24974:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9942364bc800 00000020:00000080:3.0:1789127195.801353:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127195.801368:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127195.801370:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801372:0:24974:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127195.801381:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127195.801385:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801386:0:24974:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789127195.801388:0:24974:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9942364bc800 00000020:00000080:3.0:1789127195.801390:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127195.801413:0:24974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127195.801416:0:24974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127195.801417:0:24974:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789127195.801420:0:24974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:3.0:1789127195.802736:0:24953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:3.0:1789127195.802771:0:24953:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127195.802846:0:24953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.802859:0:24953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127195.802911:0:24953:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789127195.802914:0:24953:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9942364bc800 10000000:01000000:3.0:1789127195.802917:0:24953:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9942364bc800 10000000:01000000:3.0:1789127195.802921:0:24953:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127195.802927:0:24953:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9942364bc800 from 1 10000000:01000000:3.0:1789127195.802930:0:24953:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789127195.802962:0:24953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ec60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.802971:0:24953:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ec60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.802982:0:24953:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ec60f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127195.803016:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127195.803074:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.803109:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994201254f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.803417:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276879360 00000100:00100000:0.0:1789127195.803423:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276879360 00000100:00100000:0.0:1789127195.803463:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789127195.803472:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:24953:x1876035276879360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127195.803484:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127195.803497:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364ca000/0xa840b4da666ec616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec60f expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.803518:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364ca000/0xa840b4da666ec616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec60f expref: 21 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.803528:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364ca000/0xa840b4da666ec616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec60f expref: 21 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127195.803536:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca000, rc 0) 00000100:00100000:0.0:1789127195.803573:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276879360:12345-0@lo:101:mount.lustre.0 Request processed in 102us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.803579:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789127195.805962:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127195.805989:0:24953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ec60f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec616 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.806000:0:24953:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ec60f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec616 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127195.810736:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789127195.811029:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127195.811221:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789127195.811244:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789127195.811257:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789127195.811269:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789127195.811283:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789127195.811297:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789127195.811309:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789127195.811333:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789127195.811347:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789127195.811359:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789127195.811388:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789127195.811404:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789127195.811416:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789127195.811428:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789127195.811441:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789127195.811455:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789127195.811469:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789127195.811495:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789127195.811509:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789127195.811523:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789127195.811536:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789127195.811548:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789127195.811561:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789127195.811574:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789127195.811587:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789127195.811600:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789127195.811627:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789127195.811644:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789127195.811688:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789127195.811702:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789127195.811714:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789127195.811727:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789127195.811740:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789127195.811753:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789127195.811767:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789127195.811779:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789127195.811792:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789127195.811805:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789127195.811818:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789127195.811831:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789127195.811844:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789127195.811858:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789127195.811882:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789127195.811897:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789127195.811909:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789127195.811921:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789127195.811933:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789127195.811945:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789127195.812057:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789127195.812077:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789127195.812102:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789127195.812108:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789127195.812203:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127195.812265:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.812323:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994201254d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127195.813486:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276879488 00000100:00100000:0.0:1789127195.813494:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276879488 00000100:00100000:0.0:1789127195.813540:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789127195.813547:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276879488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127195.813730:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276879488:12345-0@lo:501:mount.lustre.0 Request processed in 182us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.813737:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789127195.814453:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127195.814497:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127195.814547:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.814578:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994201254d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.817791:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276879616 00000100:00100000:1.0:1789127195.817802:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276879616 00000100:00100000:1.0:1789127195.817860:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789127195.817868:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276879616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127195.818009:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276879616:12345-0@lo:503:mount.lustre.0 Request processed in 141us (3461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.818017:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789127195.818346:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879616:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789127195.818724:0:24953:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127195.818788:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127195.818831:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.818864:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994213bef900 going to sleep for 11 seconds 00010000:00010000:2.0:1789127195.819115:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127195.819401:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276879744 00000100:00100000:1.0:1789127195.819407:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276879744 00000100:00100000:1.0:1789127195.819437:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789127195.819443:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276879744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127195.819530:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276879744:12345-0@lo:502:mount.lustre.0 Request processed in 86us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.819537:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789127195.825616:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127195.825865:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789127195.825897:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789127195.825912:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789127195.825924:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789127195.825954:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789127195.825969:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789127195.825981:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789127195.825994:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789127195.826007:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789127195.826020:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789127195.826033:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789127195.826045:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789127195.826067:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789127195.826080:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789127195.826092:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789127195.826104:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789127195.826117:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789127195.826130:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789127195.826143:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789127195.826156:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789127195.826180:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789127195.826211:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789127195.826226:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789127195.826241:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789127195.826254:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1789127195.826266:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1789127195.826279:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1789127195.826292:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1789127195.826305:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000100:00100000:1.0:1789127195.826422:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127180/real 1789127180] req@ffff99410501a580 x1876035276868480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127195.826443:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410501a580 x1876035276868480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127195 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127195.826452:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127180/real 1789127180] req@ffff99410501b0c0 x1876035276868608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127195.826470:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410501b0c0 x1876035276868608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127195 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127195.826492:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d250000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127195.826504:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127195.826507:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276868480:0@lo:8:kworker.0 00000100:00080000:1.0:1789127195.826513:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127195.826518:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127195.826521:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276868608:0@lo:8:kworker.0 00000040:00080000:3.0:1789127195.826580:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1789127195.826601:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1789127195.826615:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1789127195.826628:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1789127195.826641:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1789127195.826684:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1789127195.826699:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1789127195.826727:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1789127195.826740:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1789127195.826752:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1789127195.826765:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1789127195.826778:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1789127195.826791:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1789127195.826806:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1789127195.826821:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1789127195.826836:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1789127195.826863:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1789127195.826877:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1789127195.826891:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1789127195.826935:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127195.827003:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.827043:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994201254f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.827111:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276879872 00000100:00100000:1.0:1789127195.827117:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276879872 00000100:00100000:1.0:1789127195.827162:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789127195.827171:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276879872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127195.827291:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276879872:12345-0@lo:502:mount.lustre.0 Request processed in 120us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.827299:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789127195.827445:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276879872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127195.827594:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1789127195.827615:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1789127195.827637:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276880000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127195.827704:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.827720:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff994201254f00 going to sleep for 11 seconds 00000100:00080000:2.0:1789127195.827881:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127195.827885:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789127195.827889:0:470:0:(import.c:65:import_set_state_nolock()) ffff99423d250000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127195.827894:0:470:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:2.0:1789127195.827898:0:470:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789127195.827902:0:470:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99423d250000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127195.827922:0:470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501f0c0 x1876035276880256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127195.827937:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127195.827940:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789127195.827942:0:470:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127195.827945:0:470:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:2.0:1789127195.827947:0:470:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789127195.827950:0:470:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422d543000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127195.827960:0:470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501cb40 x1876035276880384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127195.827994:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127195.827997:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127195.828000:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127195.828003:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127195.828037:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276880128:0@lo:400:kworker.0 00000100:00100000:2.0:1789127195.828065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.828086:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127195.828090:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276880512:0@lo:400:kworker.0 00000100:00100000:2.0:1789127195.828109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.828135:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276880256:0@lo:8:kworker.0 00000100:00100000:2.0:1789127195.828154:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.828175:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276880384:0@lo:8:kworker.0 00000100:00100000:2.0:1789127195.828207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.828231:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276880640:0@lo:400:kworker.0 00000100:00100000:2.0:1789127195.828251:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.828267:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127195.828272:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276880768:0@lo:400:kworker.0 00000100:00100000:2.0:1789127195.828289:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127195.828417:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276880000 00000100:00100000:1.0:1789127195.828422:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276880000 00000100:00100000:1.0:1789127195.828448:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789127195.828455:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276880000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127195.828533:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276880000:12345-0@lo:502:mount.lustre.0 Request processed in 77us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.828541:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789127195.828629:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276880000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127195.828702:0:24953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789127195.828713:0:24953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:2.0:1789127195.829046:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276880128 00000100:00100000:2.0:1789127195.829051:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276880128 00000100:00100000:2.0:1789127195.829073:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276880640 00000100:00100000:2.0:1789127195.829075:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276880640 00000100:00100000:2.0:1789127195.829088:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127195.829094:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276880128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127195.829145:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276880128:12345-0@lo:400:kworker.0 Request processed in 50us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.829152:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127195.829164:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127195.829170:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104060f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276880640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127195.829213:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104060f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276880640:12345-0@lo:400:kworker.0 Request processed in 42us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.829227:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127195.829247:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276880512 00000100:00100000:2.0:1789127195.829251:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276880512 00000100:00100000:2.0:1789127195.829271:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276880768 00000100:00100000:2.0:1789127195.829274:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276880768 00000100:00100000:2.0:1789127195.829286:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127195.829292:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276880512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127195.829731:0:23447:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789127195.829739:0:23447:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789127195.829764:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276880256 00000100:00100000:1.0:1789127195.829768:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276880256 00000100:00100000:1.0:1789127195.829783:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276880384 00000100:00100000:1.0:1789127195.829786:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276880384 00000100:00100000:1.0:1789127195.829796:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127195.829802:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276880256:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789127195.834506:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276880256:12345-0@lo:8:kworker.0 Request processed in 4694us (6341us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789127195.834521:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127195.834554:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127195.834562:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276880384:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789127195.834581:0:24959:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789127195.834617:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276880384:12345-0@lo:8:kworker.0 Request processed in 54us (6409us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789127195.834623:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127195.834786:0:23448:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789127195.834802:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127195.834811:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104062940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276880768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127195.834853:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104062940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276880768:12345-0@lo:400:kworker.0 Request processed in 45us (6563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.834859:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127195.836123:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276880512:12345-0@lo:400:kworker.0 Request processed in 6826us (8006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.836134:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789127195.836188:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410501de00 x1876035276880768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127195.836222:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276880768:0@lo:400:kworker.0 00000100:00100000:2.0:1789127195.836238:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276880640:0@lo:400:kworker.0 00000100:00100000:2.0:1789127195.836295:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127195.836302:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d250000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127195.836306:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789127195.836310:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276880256:0@lo:8:kworker.0 00000100:00080000:2.0:1789127195.836388:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127195.836393:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127195.836396:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276880384:0@lo:8:kworker.0 00010000:00080000:3.0:1789127195.840549:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410501d680 x1876035276880512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127195.840568:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276880512:0@lo:400:kworker.0 00000100:00100000:3.0:1789127195.840583:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276880128:0@lo:400:kworker.0 00000020:01000004:0.0:1789127195.841104:0:24978:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789127195.841119:0:24978:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9941032d9a48) 00000020:00000080:0.0:1789127195.841140:0:24978:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1789127195.841233:0:24978:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9942364bc800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127195.841237:0:24978:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9942364bc800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127195.841239:0:24978:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9942364bc800 3 00010000:00080000:0.0:1789127195.841264:0:24978:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994104898800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1789127195.845716:0:24978:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789127195.845915:0:24978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789127195.845957:0:24978:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127195.845968:0:24978:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa840b4da666ec624 00000100:00080000:0.0:1789127195.845978:0:24978:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127195.845984:0:24978:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff994104898800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127195.846016:0:24978:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501b0c0 x1876035276880896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127195.846036:0:24978:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789127195.846426:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276880896:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127195.846491:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.846548:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276880896 00000100:00100000:2.0:1789127195.846559:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276880896 00000100:00100000:2.0:1789127195.846587:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127195.846594:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276880896:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127195.846617:0:23448:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 621 last 0 00000020:00000080:2.0:1789127195.846677:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa840b4da666ec62b 00000004:00100000:2.0:1789127195.846691:0:23448:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127195.846721:0:23448:0:(import.c:65:import_set_state_nolock()) ffff994102c41800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127195.846764:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104060b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876035276880896:12345-0@lo:38:llog_process_th.0 Request processed in 169us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.846773:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789127195.846808:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410501b0c0 x1876035276880896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127195.846818:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127195.846826:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789127195.846833:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789127195.846837:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127195.846839:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994104898800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127195.846845:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1876035276880896:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789127195.848445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127195.848454:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127195.848457:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127195.848460:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1789127195.850111:0:24978:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789127195.850128:0:24978:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9942366b8000) 00000020:00000080:0.0:1789127195.850151:0:24978:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789127195.850257:0:24978:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9942364bc800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127195.850262:0:24978:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9942364bc800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127195.850264:0:24978:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9942364bc800 3 00010000:00080000:0.0:1789127195.850294:0:24978:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99422d6bb800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.123@tcp at head 00010000:00010000:0.0:1789127195.858148:0:24978:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1789127195.858365:0:24978:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789127195.858420:0:24978:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127195.858432:0:24978:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa840b4da666ec639 00000100:00080000:0.0:1789127195.858443:0:24978:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127195.858449:0:24978:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99422d6bb800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127195.858482:0:24978:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410501a580 x1876035276881024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127195.858531:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276881024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127195.858605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127195.859223:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276881024 00000100:00100000:0.0:1789127195.859230:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276881024 00000100:00100000:0.0:1789127195.859270:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127195.859277:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1876035276881024:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789127195.859302:0:23447:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 621 last 0 00000020:00000080:0.0:1789127195.859343:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa840b4da666ec640 00000004:00100000:0.0:1789127195.859357:0:23447:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789127195.859397:0:23447:0:(import.c:65:import_set_state_nolock()) ffff994102c53800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127195.859449:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876035276881024:12345-0@lo:38:llog_process_th.0 Request processed in 172us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127195.859457:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789127195.859495:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410501a580 x1876035276881024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127195.859506:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127195.859513:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1789127195.859520:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789127195.859524:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789127195.859527:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d6bb800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789127195.859538:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1876035276881024:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789127195.859556:0:24978:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789127195.859581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127195.859586:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127195.859589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127195.859592:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789127195.859832:0:24978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789127195.863419:0:24953:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789127195.863466:0:24953:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127195.863492:0:24953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ec60f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec616 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127195.863505:0:24953:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e2a00/0xa840b4da666ec60f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec616 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127195.863568:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789127195.863571:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789127195.863572:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127195.863574:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127195.863575:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127195.863576:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127195.863578:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127195.863580:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127195.863581:0:24953:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127195.863585:0:24953:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789127195.863587:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127195.863588:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789127195.863590:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127195.863591:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127195.863592:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127195.863593:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127195.863595:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127195.863596:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127195.863597:0:24953:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127195.863622:0:24953:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789127195.863641:0:24953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276881152:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127195.863727:0:24953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127195.863763:0:24953:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410416fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127195.864761:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276881152 00000100:00100000:1.0:1789127195.864770:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276881152 00000100:00100000:1.0:1789127195.864819:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789127195.864829:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276881152:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789127195.864868:0:23442:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789127195.864882:0:23442:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789127195.876364:0:23442:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789127195.876386:0:23442:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789127195.876636:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:24953:x1876035276881152:12345-0@lo:253:mount.lustre.0 Request processed in 11805us (12906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127195.876665:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 20000000:01000000:2.0:1789127195.876735:0:23463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789127195.876739:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789127195.876758:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.876781:0:23463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec58a expref: 20 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.876789:0:23463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec598 expref: 20 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.876796:0:23463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.876829:0:23463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec598 expref: 20 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.876844:0:23463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec598 expref: 20 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127195.876858:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276881280:0@lo:104: 00000100:00100000:2.0:1789127195.876891:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127195.876934:0:23463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec58a expref: 20 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.876942:0:23463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec58a expref: 20 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127195.876950:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276881408:0@lo:104: 00000100:00100000:2.0:1789127195.876969:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.876984:0:23463:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127195.877004:0:23430:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789127195.877019:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276881280 00000100:00100000:2.0:1789127195.877025:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276881280 00000100:00100000:2.0:1789127195.877054:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276881408 00000100:00100000:2.0:1789127195.877057:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276881408 00000100:00100000:2.0:1789127195.877067:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127195.877073:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104061a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+4:23463:x1876035276881280:12345-0@lo:104: 00010000:00010000:2.0:1789127195.877084:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877120:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127195.877124:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104061a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+4:23463:x1876035276881280:12345-0@lo:104: Request processed in 52us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.877130:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127195.877140:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127195.877145:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994205c06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276881408:12345-0@lo:104: 00010000:00010000:2.0:1789127195.877151:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877175:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789127195.877179:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994205c06c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276881408:12345-0@lo:104: Request processed in 34us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.877184:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127195.877236:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276881280:0@lo:104: 00000100:00100000:2.0:1789127195.877244:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276881408:0@lo:104: 00010000:00010000:2.0:1789127195.877262:0:23463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877276:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127195.877282:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877299:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789127195.877303:0:23436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877311:0:23436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127195.877382:0:23436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127195.877387:0:23436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127195.877416:0:23436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877423:0:23436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127195.877441:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877447:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3400/0xa840b4da666ec598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec59f expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877459:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127195.877463:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877468:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789127195.877471:0:23436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877487:0:23436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127195.877493:0:23436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127195.877497:0:23436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127195.877509:0:23436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877514:0:23436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127195.877520:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877526:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e2e00/0xa840b4da666ec58a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec591 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877537:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127195.877539:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127195.877540:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127195.877546:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127195.877562:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276881536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127195.877588:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.877610:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127195.877615:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276881664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127195.877635:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127195.877692:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276881536 00000100:00100000:2.0:1789127195.877695:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276881536 00010000:00010000:2.0:1789127195.877719:0:23432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec598 expref: 21 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127195.877738:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276881664 00000100:00100000:2.0:1789127195.877741:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276881664 00010000:00010000:2.0:1789127195.877751:0:23432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec58a expref: 22 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127195.877766:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127195.877772:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104061a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:3639:x1876035276881536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127195.877782:0:23432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127195.877787:0:23432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec598 expref: 22 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877796:0:23432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec598 expref: 22 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877810:0:23432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589c00/0xa840b4da666ec59f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec598 expref: 22 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877822:0:23432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127195.877849:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104061a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:3639:x1876035276881536:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.877856:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127195.877868:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127195.877874:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:3639:x1876035276881664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127195.877881:0:23432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127195.877885:0:23432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec58a expref: 20 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877905:0:23432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec58a expref: 20 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877915:0:23432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589e00/0xa840b4da666ec591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec58a expref: 20 pid: 23441 timeout: 721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877925:0:23432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877933:0:23432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789127195.877944:0:23432:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006293340s 00010000:00010000:2.0:1789127195.877949:0:23432:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877956:0:23432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877963:0:23432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877969:0:23432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877975:0:23432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127195.877978:0:23432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.877985:0:23432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.878002:0:23432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.878011:0:23432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127195.878033:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:3639:x1876035276881664:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127195.878040:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127195.878092:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276881664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127195.878100:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276881536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127195.878117:0:23463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.878124:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127195.878131:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589600/0xa840b4da666ec647 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127195.881754:0:24953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:24953:1876035276881152:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789127195.881773:0:24953:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789127195.881777:0:24953:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789127195.881779:0:24953:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789127195.881780:0:24953:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127195.881781:0:24953:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127195.881783:0:24953:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127195.881784:0:24953:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127195.881786:0:24953:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127195.881788:0:24953:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127195.881789:0:24953:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789127195.881803:0:24953:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1789127195.888165:0:24953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789127195.890112:0:24953:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789127195.890119:0:24953:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789127195.890167:0:24953:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789127195.890217:0:24953:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789127195.890235:0:24953:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789127195.890254:0:24953:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789127195.890998:0:24953:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127195.891173:0:24953:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1789127196.815017:0:25037:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127196.815279:0:25037:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127196.843819:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789127197.290820:0:23444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789127197.290830:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99422043b000 from 13 10000000:01000000:2.0:1789127197.290835:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789127197.290875:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127197.290887:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127197.290898:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127197.290930:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276881792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127197.291003:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127197.293343:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410404d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127197.295001:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276881792 00000100:00100000:3.0:1789127197.295017:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276881792 00000100:00100000:3.0:1789127197.295090:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127197.295100:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+19:23444:x1876035276881792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127197.295116:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127197.295134:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec64e expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127197.295161:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec64e expref: 20 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127197.295172:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec64e expref: 20 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127197.295191:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3e00, rc 0) 00000100:00100000:3.0:1789127197.295271:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:23444:x1876035276881792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (4268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127197.295279:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789127197.297015:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276881792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127197.297058:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127197.297072:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127197.297143:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276881920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789127197.297221:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127197.297267:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410404d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127197.297732:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276881920 00000100:00100000:3.0:1789127197.297740:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276881920 00000100:00100000:3.0:1789127197.297801:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127197.297811:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:23444:x1876035276881920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789127197.297841:0:23442:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789127197.297870:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789127197.297874:0:23442:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1789127197.297967:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:23444:x1876035276881920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 156us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127197.297976:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789127197.298281:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276881920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789127197.298458:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127197.298468:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127197.298478:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127197.298488:0:23444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789127197.298491:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994103e26000 from 13 10000000:01000000:2.0:1789127197.298494:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789127197.298521:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127197.298539:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127197.298549:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127197.298567:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276882048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127197.298601:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127197.298635:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410404d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127197.298738:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276882048 00000100:00100000:1.0:1789127197.298743:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276882048 00000100:00100000:1.0:1789127197.298775:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789127197.298782:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:23444:x1876035276882048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127197.298793:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127197.298807:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec65c expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127197.298827:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec65c expref: 21 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127197.298837:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec65c expref: 21 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127197.298847:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99420148f800, rc 0) 00000100:00100000:1.0:1789127197.300003:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:23444:x1876035276882048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1216us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127197.300013:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789127197.300153:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276882048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127197.300176:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127197.300476:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127197.300542:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276882176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789127197.300580:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127197.300610:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994204e45000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127197.301134:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276882176 00000100:00100000:2.0:1789127197.301141:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276882176 00000100:00100000:2.0:1789127197.301302:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789127197.301531:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:23444:x1876035276882176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789127197.301551:0:23439:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127197.301570:0:23439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127197.301573:0:23439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1789127197.302402:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:23444:x1876035276882176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 872us (1818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127197.302411:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789127197.309831:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276882176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789127197.309936:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127197.309946:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127197.309957:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127197.869600:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276882304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127197.869709:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127197.869770:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276882304 00000100:00100000:3.0:1789127197.869777:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276882304 00000100:00100000:3.0:1789127197.869821:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127197.869828:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276882304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127197.869859:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789127197.869898:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276882304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127197.869905:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127197.869944:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276882304:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789127197.870997:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127197.871124:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276882432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127197.871175:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127197.871263:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276882432 00000100:00100000:2.0:1789127197.871269:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276882432 00000100:00100000:2.0:1789127197.871304:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789127197.871313:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276882432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127197.871337:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127197.871386:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276882432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127197.871404:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127197.872215:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276882432:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789127198.890974:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127199.915616:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127200.939580:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789127200.946748:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127200.946756:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789127200.946760:0:8:0:(import.c:65:import_set_state_nolock()) ffff99423d250000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127200.946773:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99423d250000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127200.946796:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9941040621c0 x1876035276882816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127200.946816:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127200.946819:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789127200.946821:0:8:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127200.946825:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 621 00000100:00080000:2.0:1789127200.946830:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789127200.946834:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422d543000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127200.946844:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104060780 x1876035276882944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127200.946885:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127200.946889:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127200.946892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127200.946896:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127200.946956:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276882560:0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.947046:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127200.947088:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276883328:0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.947116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127200.947142:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789127200.947149:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276882688:0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.947183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127200.947202:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276883456:0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.947222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127200.947252:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276883200:0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.947276:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127200.947483:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276883072:0@lo:400:kworker.0 00000100:00100000:3.0:1789127200.947513:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127200.947531:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276883584:0@lo:400:kworker.0 00000100:00100000:3.0:1789127200.947557:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127200.948227:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276882560 00000100:00100000:2.0:1789127200.948235:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276882560 00000100:00100000:2.0:1789127200.948277:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789127200.948297:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:3639:x1876035276882560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.948350:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:3639:x1876035276882560:12345-0@lo:400:kworker.0 Request processed in 54us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127200.948357:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789127200.948389:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276883328 00000100:00100000:2.0:1789127200.948393:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276883328 00000100:00100000:2.0:1789127200.948412:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276883456 00000100:00100000:2.0:1789127200.948414:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276883456 00000100:00100000:2.0:1789127200.948440:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276883072 00000100:00100000:2.0:1789127200.948443:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276883072 00000100:00100000:2.0:1789127200.948453:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276883584 00000100:00100000:2.0:1789127200.948456:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276883584 00000100:00100000:2.0:1789127200.948470:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127200.948477:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276883328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.948519:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276883328:12345-0@lo:400:kworker.0 Request processed in 43us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127200.948525:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127200.948537:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127200.948556:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276883456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.948584:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276883456:12345-0@lo:400:kworker.0 Request processed in 42us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127200.948589:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127200.948601:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127200.948607:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276883072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.948642:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276883072:12345-0@lo:400:kworker.0 Request processed in 35us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127200.948667:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127200.948679:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127200.948686:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276883584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127200.948715:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276883584:12345-0@lo:400:kworker.0 Request processed in 30us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127200.948721:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127200.949219:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276882816:0@lo:8:kworker.0 00000100:00100000:3.0:1789127200.949263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127200.950936:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276882944:0@lo:8:kworker.0 00000100:00100000:3.0:1789127200.950983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127200.951045:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276882816 00000100:00100000:3.0:1789127200.951052:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276882816 00000100:00100000:3.0:1789127200.951079:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276882944 00000100:00100000:3.0:1789127200.951082:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276882944 00000100:00100000:3.0:1789127200.951095:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127200.951100:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276882816:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789127200.951130:0:24959:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:3.0:1789127200.951170:0:24959:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ec66a 00002000:00100000:3.0:1789127200.951184:0:24959:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99423cb1c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789127200.951188:0:24959:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789127200.951190:0:24959:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789127200.951832:0:24959:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789127200.951860:0:24959:0:(import.c:65:import_set_state_nolock()) ffff99423cb19000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127200.951916:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876035276882816:12345-0@lo:8:kworker.0 Request processed in 813us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127200.951924:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127200.951942:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127200.951946:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276882944:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789127200.951960:0:24959:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789127200.952456:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276882688 00000100:00100000:1.0:1789127200.952462:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276882688 00000100:00100000:1.0:1789127200.952492:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276883200 00000100:00100000:1.0:1789127200.952495:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276883200 00000100:00100000:1.0:1789127200.952510:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127200.952516:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276882688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127200.952558:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276882688:12345-0@lo:400:kworker.0 Request processed in 42us (5375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127200.952563:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127200.952577:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127200.952582:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276883200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127200.952671:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276883200:12345-0@lo:400:kworker.0 Request processed in 88us (5393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127200.952690:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789127200.952718:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127200.952722:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789127200.957924:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994104062d00 x1876035276883072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127200.957941:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276883072:0@lo:400:kworker.0 00010000:00080000:1.0:1789127200.957957:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410501d680 x1876035276883584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127200.957965:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276883584:0@lo:400:kworker.0 00000100:00100000:1.0:1789127200.958067:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276882688:0@lo:400:kworker.0 00010000:00080000:1.0:1789127200.958083:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410501da40 x1876035276883456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127200.958093:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276883456:0@lo:400:kworker.0 00000100:00100000:1.0:1789127200.958103:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104061680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276882560:0@lo:400:kworker.0 00010000:00080000:1.0:1789127200.958113:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99410501e580 x1876035276883328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127200.958121:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276883328:0@lo:400:kworker.0 00000100:00100000:0.0:1789127200.959543:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276883200:0@lo:400:kworker.0 00010000:00080000:0.0:1789127200.960508:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941040621c0 x1876035276882816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789127200.960526:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789127200.960535:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789127200.960540:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789127200.960544:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99423d250000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789127200.960565:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789127200.960571:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276882816:0@lo:8:kworker.0 00000004:00080000:0.0:1789127200.960625:0:23472:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1789127200.960642:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23472:1876035276883840:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789127200.960708:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127200.960731:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127200.960742:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276883712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127200.960761:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127200.960790:0:24958:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789127200.960805:0:24958:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:1.0:1789127200.961560:0:23471:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789127200.961667:0:23471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 626166018427ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789127200.961677:0:23471:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789127200.976849:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276883712 00000100:00100000:0.0:1789127200.976864:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276883712 00000100:00100000:0.0:1789127200.976943:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127200.976954:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276883712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127200.976986:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789127200.977069:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276883712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (16306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127200.977076:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789127200.977122:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941050183c0 x1876035276883712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127200.977144:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276883712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789127200.980683:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127200.982080:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276883840 00000100:00100000:2.0:1789127200.982092:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276883840 00000100:00100000:2.0:1789127200.982234:0:25262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127200.982244:0:25262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23472:x1876035276883840:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789127200.986064:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276882944:12345-0@lo:8:kworker.0 Request processed in 34109us (35074us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789127200.986079:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789127200.986144:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127200.986150:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00002000:00080000:2.0:1789127200.988034:0:25262:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789127200.988044:0:25262:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789127200.988050:0:25262:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:0.0:1789127200.988066:0:23427:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789127200.992535:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276882944:0@lo:8:kworker.0 00002000:00010000:3.0:1789127200.999366:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127200.999377:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127200.999394:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127200.999399:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127200.999406:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127200.999422:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127200.999431:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127200.999439:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127200.999537:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789127200.999923:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127200.999930:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127200.999941:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127200.999951:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127200.999957:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127200.999968:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127200.999977:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127200.999985:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000221:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789127201.000271:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127201.000279:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.000296:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.000301:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.000310:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.000436:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.000501:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.000509:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1410a23/0xa840b4da666ec671 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.000525:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.000527:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.000529:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127201.000634:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.000641:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000669:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.000673:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.000678:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000689:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000697:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000711:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000726:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127201.000735:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127201.000739:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000746:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127201.000749:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000756:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000767:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000774:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4fc4efc/0xa840b4da666ec67f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.000787:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.000788:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.000791:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.000882:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.000888:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.000897:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.000900:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.000909:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.000927:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.000934:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ec678 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.000947:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.000949:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.000951:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.000956:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.000957:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127201.001110:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.001121:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001127:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.001129:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.001134:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001143:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001151:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001168:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001188:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127201.001216:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.001220:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001228:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.001231:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001240:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001250:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001258:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8cf37fa/0xa840b4da666ec686 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001278:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.001279:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.001281:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127201.001451:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.001457:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001465:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.001468:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.001472:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001481:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001495:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001502:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.001523:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127201.001554:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.001559:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001567:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.001571:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001579:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001591:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001598:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059011ba9/0xa840b4da666ec68d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.001612:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.001614:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.001615:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127201.002511:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.002520:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.002531:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.002534:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.002539:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.002549:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.002557:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.002565:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.002642:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789127201.003195:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.003202:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.003212:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.003215:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.003220:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.003231:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.003239:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.003246:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003346:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127201.003353:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003375:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.003378:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003387:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003402:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003409:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ec694 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003427:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.003432:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003438:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.003441:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003447:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003456:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.003469:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.003471:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.003473:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.003537:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.003542:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec69b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.003873:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.003878:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.003892:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.003895:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.003900:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.003910:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.003919:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.003927:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.004182:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.004188:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.004195:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.004199:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.004207:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.004218:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.004226:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.004228:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.004229:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.004414:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.004419:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec6a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.004953:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127201.005082:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.005088:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005098:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.005102:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.005107:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005127:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005136:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005143:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005407:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127201.005641:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.005661:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.005670:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.005680:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.005688:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.005702:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.005709:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ff8097/0xa840b4da666ec6a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.005726:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.005728:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.005730:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127201.005803:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.005829:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005838:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.005841:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.005846:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005855:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005862:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005878:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.005894:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789127201.006097:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.006103:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006111:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.006114:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.006118:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006126:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006132:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006139:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006167:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127201.006176:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127201.006180:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006193:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127201.006197:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006205:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006215:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006220:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf105a1/0xa840b4da666ec6b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006231:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127201.006233:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006236:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127201.006238:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006243:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006248:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006257:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ffd0475/0xa840b4da666ec6b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006264:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.006265:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.006266:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127201.006564:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.006569:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006578:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.006581:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.006585:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006593:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006600:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006606:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.006618:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127201.006870:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.006877:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.006885:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.006888:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.006897:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.006909:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.006923:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b08e1e8/0xa840b4da666ec6be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.006938:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.006940:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.006942:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.006948:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127201.007014:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.007024:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.007033:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.007036:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.007040:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.007050:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.007058:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.007066:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.007115:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789127201.007442:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.007448:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.007457:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.007460:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.007464:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.007472:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.007486:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.007493:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007524:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127201.007529:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007536:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.007539:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007546:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007557:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007565:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a256843/0xa840b4da666ec6c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007580:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.007584:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007596:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.007599:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007607:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007617:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.007626:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.007627:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.007629:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.007739:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.007745:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b03c50a/0xa840b4da666ec6cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.008029:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.008035:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.008043:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.008046:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.008051:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.008060:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.008069:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.008087:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.008395:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.008401:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.008408:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.008412:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.008420:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.008431:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.008446:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.008447:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.008449:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.008510:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.008515:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a2a7cae/0xa840b4da666ec6d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.008871:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.008877:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.008886:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.008890:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.008894:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.008904:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.008913:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.008920:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009022:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.009027:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009035:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.009038:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009047:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009058:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009067:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.009068:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.009070:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.009125:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.009130:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dacb06d/0xa840b4da666ec6da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.009445:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.009451:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.009460:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.009463:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.009467:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.009476:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.009485:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.009492:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009527:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.009533:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009539:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.009543:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009556:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009568:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.009577:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.009579:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.009580:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.009639:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.009644:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000552e219b/0xa840b4da666ec6e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.010233:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.010239:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.010248:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.010252:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.010256:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.010266:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.010274:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.010281:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.010444:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.010450:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.010458:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.010461:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.010470:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.010483:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.010491:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.010493:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.010494:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.010557:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.010562:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ea1a3f/0xa840b4da666ec6e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.010880:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.010887:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.010907:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.010910:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.010915:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.010925:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.010934:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.010941:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.010990:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.010995:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.011003:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.011006:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.011014:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.011026:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.011034:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.011035:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.011037:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.011092:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.011097:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d1022b/0xa840b4da666ec6ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.011403:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.011409:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.011418:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.011421:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.011426:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.011447:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.011456:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.011463:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.011493:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.011499:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.011506:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.011510:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.011518:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.011539:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.011546:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.011548:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.011550:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.011608:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.011614:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b16eaf39/0xa840b4da666ec6f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.011937:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.011943:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.011952:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.011955:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.011960:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.011969:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.011988:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.011996:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012042:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.012047:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012054:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.012058:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012066:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012078:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012086:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.012088:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.012089:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.012143:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.012148:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2f29479/0xa840b4da666ec6fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.012676:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.012682:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.012690:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.012693:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.012697:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.012707:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.012715:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.012734:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012808:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.012814:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012831:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.012835:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012844:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012856:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.012865:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.012867:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.012868:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.012927:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.012932:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4258805/0xa840b4da666ec704 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.013205:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.013211:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.013220:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.013223:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.013228:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.013237:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.013245:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.013253:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.013343:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.013348:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.013356:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104396c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.013360:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.013369:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.013379:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.013393:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.013395:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.013397:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.013454:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.013459:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025bb7811/0xa840b4da666ec70b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.014783:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.014793:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.014805:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.014809:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.014813:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.014822:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.014830:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.014837:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.014902:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.014908:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.014915:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994104397600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.014919:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.014926:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.014939:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.014996:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127201.014999:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127201.015001:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.015052:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.015057:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa323817/0xa840b4da666ec712 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.015416:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.015422:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.015430:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.015433:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.015437:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.015445:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.015453:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.015460:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.015489:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.015494:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.015500:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.015503:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.015520:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.015530:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.015537:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.015539:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.015540:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.015589:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.015593:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000218b6c3/0xa840b4da666ec719 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.015860:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.015866:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.015893:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.015895:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.015899:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.015908:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.015915:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.015920:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.016137:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.016142:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.016150:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.016153:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.016170:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.016180:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.016188:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.016190:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.016191:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.016269:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.016274:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cb4ade6/0xa840b4da666ec720 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.016566:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.016571:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.016580:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.016583:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.016587:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.016604:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.016611:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.016617:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.016667:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127201.016673:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.016680:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127201.016683:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.016690:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.016711:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.016718:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127201.016720:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127201.016722:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.016826:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.016830:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055115d8b/0xa840b4da666ec727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.017086:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.017091:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017099:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.017102:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.017105:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017113:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017130:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017136:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.017205:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.017210:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.017217:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.017220:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.017228:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.017239:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017433:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.017439:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8113212/0xa840b4da666ec72e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.017674:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127201.017788:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.017793:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017801:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.017804:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.017808:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017816:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017823:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017840:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.017889:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789127201.018176:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.018182:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.018191:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.018194:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.018198:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.018206:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.018213:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.018219:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018295:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127201.018301:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018309:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127201.018313:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018321:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018334:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018341:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc58edc6/0xa840b4da666ec735 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018359:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127201.018362:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018380:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127201.018383:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018391:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018401:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127201.018409:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127201.018411:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.018430:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127201.018500:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127201.018506:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000016fe5e0/0xa840b4da666ec73c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127201.018810:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127201.018816:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.018825:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=626s v=(0 0) 00010000:00010000:3.0:1789127201.018828:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127201.018832:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.018842:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.018850:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.018858:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127201.018869:0:25262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789127201.018894:0:25262:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:3.0:1789127201.018981:0:25262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23472:x1876035276883840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 36735us (58268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127201.018990:0:25262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127201.019042:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23472:1876035276883840:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789127201.019057:0:23472:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1789127201.019106:0:23472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422051e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23472:1876035276883968:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789127201.019138:0:23472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127201.019171:0:23472:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127201.019189:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276883968 00000100:00100000:3.0:1789127201.019193:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276883968 00000100:00100000:3.0:1789127201.019230:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127201.019239:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23472:x1876035276883968:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789127201.019271:0:24958:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1789127201.019375:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127201.019382:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.019390:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127201.019393:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.019402:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.019414:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.019427:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070042e5d/0xa840b4da666ec743 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127201.019443:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.019445:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.019447:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127201.019452:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127201.019497:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789127201.026804:0:24954:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1789127201.026847:0:24954:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789127201.027126:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:23472:x1876035276883968:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7883us (7982us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789127201.027137:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127201.027233:0:23472:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789127201.027241:0:23472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422051e940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23472:1876035276883968:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789127201.027255:0:23472:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1789127201.962927:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127202.166776:0:25329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1789127202.283481:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127202.986744:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127202.988093:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276884096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127202.988176:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127202.988967:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276884096 00000100:00100000:3.0:1789127202.988974:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276884096 00000100:00100000:3.0:1789127202.989089:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127202.989099:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276884096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127202.989129:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127202.989188:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276884096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127202.989242:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127202.989291:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276884096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127202.991245:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127202.991262:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276884224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127202.991316:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127202.991353:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276884224 00000100:00100000:0.0:1789127202.991358:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276884224 00000100:00100000:0.0:1789127202.991391:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127202.991398:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276884224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127202.991424:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789127202.991471:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276884224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127202.991478:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127202.991530:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276884224:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1789127203.009058:0:25381:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127203.010528:0:25381:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:3.0:1789127203.818477:0:25431:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127203.818828:0:25431:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789127204.011312:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789127204.015205:0:24206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127205.034898:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127206.060338:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276884352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127206.060411:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127206.060572:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276884352 00000100:00100000:3.0:1789127206.060578:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276884352 00000100:00100000:3.0:1789127206.060643:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127206.060676:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276884352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127206.060719:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915853824 avail 3684331520 00000100:00080000:1.0:1789127206.060787:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127206.061633:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276884352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 963us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127206.061643:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789127206.061692:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127206.061867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127206.061871:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789127206.061874:0:8:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127206.061879:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 626 00000100:00080000:1.0:1789127206.061883:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789127206.061889:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422d543000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127206.061911:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423664e580 x1876035276884736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127206.061916:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276884608:0@lo:400:kworker.0 00000100:00080000:1.0:1789127206.061953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127206.061957:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127206.061968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789127206.061975:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127206.061979:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127206.062009:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127206.062018:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276884864:0@lo:400:kworker.0 00000100:00100000:1.0:1789127206.062044:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276884480:0@lo:400:kworker.0 00000100:00100000:2.0:1789127206.062051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127206.062075:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276885248:0@lo:400:kworker.0 00000100:00100000:1.0:1789127206.062104:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127206.062109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127206.062150:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276885120:0@lo:400:kworker.0 00000100:00100000:2.0:1789127206.062151:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127206.062162:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276885376:0@lo:400:kworker.0 00000100:00100000:1.0:1789127206.062184:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127206.062207:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276884736:0@lo:8:kworker.0 00000100:00100000:1.0:1789127206.062221:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127206.062230:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276884992:0@lo:400:kworker.0 00000100:00100000:2.0:1789127206.062237:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127206.062271:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127206.062309:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276884864 00000100:00100000:1.0:1789127206.062313:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276884864 00000100:00100000:2.0:1789127206.062325:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276884608 00000100:00100000:2.0:1789127206.062332:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276884608 00000100:00100000:1.0:1789127206.062346:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276885248 00000100:00100000:1.0:1789127206.062351:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276885248 00000100:00100000:2.0:1789127206.062363:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276884992 00000100:00100000:2.0:1789127206.062368:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276884992 00000100:00100000:1.0:1789127206.062381:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276885120 00000100:00100000:1.0:1789127206.062386:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276885120 00000100:00100000:2.0:1789127206.062392:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127206.062402:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276884608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127206.062408:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127206.062420:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276884864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127206.062466:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276884608:12345-0@lo:400:kworker.0 Request processed in 65us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127206.062474:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276884864:12345-0@lo:400:kworker.0 Request processed in 56us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127206.062478:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127206.062487:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127206.062502:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127206.062510:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127206.062513:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276884992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127206.062522:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276885248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127206.062557:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276884992:12345-0@lo:400:kworker.0 Request processed in 46us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127206.062565:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276885248:12345-0@lo:400:kworker.0 Request processed in 45us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127206.062566:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127206.062576:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127206.062593:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127206.062602:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276885120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127206.062630:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1876035276885120:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127206.062846:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276884352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789127206.062903:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127206.062923:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276884736 00000100:00100000:0.0:1789127206.062927:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276884736 00000100:00100000:0.0:1789127206.062950:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127206.062955:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276884736:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789127206.062972:0:24959:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789127206.063211:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276884992:0@lo:400:kworker.0 00010000:00080000:3.0:1789127206.063243:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664de00 x1876035276885120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127206.063254:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1876035276885120:0@lo:400:kworker.0 00000100:00100000:0.0:1789127206.063396:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1876035276884736:12345-0@lo:8:kworker.0 Request processed in 438us (1157us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127206.063402:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789127206.063424:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276884480 00000100:00100000:0.0:1789127206.063428:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276884480 00000100:00100000:0.0:1789127206.063456:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789127206.063463:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:3642:x1876035276884480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127206.063501:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:3642:x1876035276884480:12345-0@lo:400:kworker.0 Request processed in 39us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127206.063508:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789127206.063545:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276884480:0@lo:400:kworker.0 00000100:00100000:0.0:1789127206.063567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789127206.063601:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664cb40 x1876035276885248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127206.063612:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276885248:0@lo:400:kworker.0 00010000:00080000:0.0:1789127206.063639:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664d2c0 x1876035276884864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127206.063667:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276884864:0@lo:400:kworker.0 00000100:00100000:0.0:1789127206.063680:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276884608:0@lo:400:kworker.0 00000100:00100000:0.0:1789127206.063702:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276885376 00000100:00100000:0.0:1789127206.063705:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276885376 00000100:00080000:1.0:1789127206.063853:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127206.063918:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127206.063923:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789127206.063927:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276884736:0@lo:8:kworker.0 00000100:00100000:2.0:1789127206.068366:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127206.068493:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127206.068513:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276885376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127206.068607:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276885376:12345-0@lo:400:kworker.0 Request processed in 103us (5037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127206.068613:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789127206.068686:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664f480 x1876035276885376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127206.068702:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276885376:0@lo:400:kworker.0 00010000:00010000:2.0:1789127207.086330:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127207.087171:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127192/real 1789127192] req@ffff99410501e1c0 x1876035276877568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127207.087198:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410501e1c0 x1876035276877568/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127207.087208:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127192/real 1789127192] req@ffff99410501c3c0 x1876035276877696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127207.087220:0:3638:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99410501c3c0 x1876035276877696/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789127207.087291:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d6b9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127207.087310:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789127207.087329:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276877568:0@lo:8:kworker.0 00000100:00080000:2.0:1789127207.087335:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127207.087340:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789127207.087343:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276877696:0@lo:8:kworker.0 00000100:00080000:1.0:1789127207.087455:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127207.087460:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789127207.087463:0:8:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127207.087468:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:1.0:1789127207.087471:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789127207.087477:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422d543000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127207.087494:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423664d2c0 x1876035276885888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127207.087514:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127207.087517:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789127207.087518:0:8:0:(import.c:65:import_set_state_nolock()) ffff99422d6b9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127207.087521:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 617 00000100:00080000:1.0:1789127207.087524:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789127207.087527:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99422d6b9000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127207.087534:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423664de00 x1876035276886272/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127207.087541:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127207.087544:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789127207.087545:0:8:0:(import.c:65:import_set_state_nolock()) ffff9941032b7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127207.087548:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 617 00000100:00080000:1.0:1789127207.087550:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789127207.087553:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9941032b7800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127207.087561:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423664f0c0 x1876035276886400/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127207.087630:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276885504:0@lo:400:kworker.0 00000100:00100000:2.0:1789127207.087720:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127207.087759:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276886144:0@lo:400:kworker.0 00000100:00100000:2.0:1789127207.087784:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127207.087806:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789127207.087812:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276885632:0@lo:400:kworker.0 00000100:00100000:2.0:1789127207.087837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127207.087855:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276886528:0@lo:400:kworker.0 00000100:00100000:2.0:1789127207.087875:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127207.087903:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276886144 00000100:00100000:2.0:1789127207.087909:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276886144 00000100:00100000:2.0:1789127207.087938:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276885632 00000100:00100000:2.0:1789127207.087941:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276885632 00000100:00100000:2.0:1789127207.087953:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127207.087961:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276886144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127207.088382:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276885504 00000100:00100000:1.0:1789127207.088396:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276885504 00000100:00100000:1.0:1789127207.088429:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789127207.088437:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:3641:x1876035276885504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127207.088481:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:3641:x1876035276885504:12345-0@lo:400:kworker.0 Request processed in 45us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127207.088488:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789127207.088522:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276886528 00000100:00100000:1.0:1789127207.088526:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276886528 00000100:00100000:1.0:1789127207.088551:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789127207.088557:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e857c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276886528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127207.088588:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e857c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276886528:12345-0@lo:400:kworker.0 Request processed in 31us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127207.088594:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789127207.088632:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664da40 x1876035276886528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127207.088643:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276886528:0@lo:400:kworker.0 00000100:00100000:1.0:1789127207.088666:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276885504:0@lo:400:kworker.0 00000100:00100000:3.0:1789127207.089100:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276886016:0@lo:400:kworker.0 00000100:00100000:3.0:1789127207.089145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127207.089167:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276886784:0@lo:400:kworker.0 00000100:00100000:3.0:1789127207.089188:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127207.089209:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789127207.089215:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276885760:0@lo:400:kworker.0 00000100:00100000:3.0:1789127207.089237:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127207.089256:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276886656:0@lo:400:kworker.0 00000100:00100000:3.0:1789127207.089281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127207.089306:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276886016 00000100:00100000:3.0:1789127207.089309:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276886016 00000100:00100000:2.0:1789127207.090229:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276886144:12345-0@lo:400:kworker.0 Request processed in 2263us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127207.090251:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127207.090276:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127207.090285:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276885632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127207.090325:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276885632:12345-0@lo:400:kworker.0 Request processed in 43us (2487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127207.090344:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127207.090371:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276885760 00000100:00100000:2.0:1789127207.090376:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276885760 00000100:00100000:2.0:1789127207.090409:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127207.090416:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276885760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127207.090454:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276885760:12345-0@lo:400:kworker.0 Request processed in 39us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127207.090460:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127207.090483:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276885888:0@lo:8:kworker.0 00000100:00100000:2.0:1789127207.090511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127207.090531:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276886272:0@lo:8:kworker.0 00000100:00100000:2.0:1789127207.090554:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127207.090577:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276886400:0@lo:8:kworker.0 00000100:00100000:2.0:1789127207.090601:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127207.090630:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276885888 00000100:00100000:2.0:1789127207.090634:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276885888 00000100:00100000:2.0:1789127207.090660:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276886272 00000100:00100000:2.0:1789127207.090664:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276886272 00000100:00100000:2.0:1789127207.090672:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276886400 00000100:00100000:2.0:1789127207.090674:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276886400 00000100:00100000:2.0:1789127207.090683:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127207.090687:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1876035276885888:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789127207.090704:0:24960:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789127207.090737:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1876035276885888:12345-0@lo:8:kworker.0 Request processed in 48us (224us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789127207.090743:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127207.090762:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127207.090766:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1876035276886272:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789127207.090783:0:24960:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 632 last 0 00000020:00000080:2.0:1789127207.090813:0:24960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ec74a 00002000:00100000:2.0:1789127207.090826:0:24960:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99421fcec800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789127207.090830:0:24960:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789127207.090833:0:24960:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789127207.090905:0:24960:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789127207.090927:0:24960:0:(import.c:65:import_set_state_nolock()) ffff99421fceb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127207.090959:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8561c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1876035276886272:12345-0@lo:8:kworker.0 Request processed in 191us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127207.090980:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127207.091124:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276886784 00000100:00100000:1.0:1789127207.091128:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276886784 00000100:00100000:1.0:1789127207.091155:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276886656 00000100:00100000:1.0:1789127207.091158:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276886656 00000100:00100000:1.0:1789127207.091173:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127207.091180:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276886784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127207.091215:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276886784:12345-0@lo:400:kworker.0 Request processed in 36us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127207.091221:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127207.091242:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789127207.091248:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276886656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127207.091275:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276886656:12345-0@lo:400:kworker.0 Request processed in 28us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127207.091281:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127207.091919:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127207.091929:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276886016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127207.091981:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276886016:12345-0@lo:400:kworker.0 Request processed in 54us (2834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127207.091987:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127207.092052:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276885760:0@lo:400:kworker.0 00010000:00080000:3.0:1789127207.092067:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994104061a40 x1876035276886656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127207.092078:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104061a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276886656:0@lo:400:kworker.0 00010000:00080000:3.0:1789127207.092089:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423664cb40 x1876035276886016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127207.092097:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276886016:0@lo:400:kworker.0 00010000:00080000:3.0:1789127207.092108:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994104060780 x1876035276886784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127207.092128:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104060780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276886784:0@lo:400:kworker.0 00000100:00100000:1.0:1789127207.095280:0:25262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127207.095294:0:25262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1876035276886400:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789127207.095318:0:25262:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789127207.095394:0:25262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1876035276886400:12345-0@lo:8:kworker.0 Request processed in 103us (4791us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789127207.095402:0:25262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127207.095469:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276885632:0@lo:400:kworker.0 00000100:00100000:1.0:1789127207.095482:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276886144:0@lo:400:kworker.0 00000100:00080000:2.0:1789127207.098947:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127207.099469:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127207.099477:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276885888:0@lo:8:kworker.0 00000100:00100000:2.0:1789127207.099498:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127207.099507:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789127207.099516:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789127207.099522:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789127207.099525:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d6b9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789127207.099552:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789127207.099558:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276886272:0@lo:8:kworker.0 00000100:00080000:2.0:1789127207.099573:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127207.099577:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127207.099580:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276886400:0@lo:8:kworker.0 00000004:00080000:0.0:1789127207.099698:0:24191:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789127207.099722:0:24191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24191:1876035276887040:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789127207.099784:0:24191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127207.099810:0:24191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127207.099822:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127207.099830:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276886912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127207.099859:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127207.099889:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276886912 00000100:00100000:0.0:1789127207.099894:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276886912 00000100:00100000:0.0:1789127207.099952:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127207.099961:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1876035276886912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127207.099995:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789127207.100037:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1876035276886912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127207.100045:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127207.100081:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276886912:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789127207.100090:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127207.100099:0:25262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276887040 00000100:00100000:0.0:1789127207.100102:0:25262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276887040 00000100:00100000:0.0:1789127207.100142:0:25262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127207.100150:0:25262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:24191:x1876035276887040:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789127207.101185:0:24190:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789127207.101269:0:24190:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 632305619784ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789127207.101276:0:24190:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789127207.103941:0:24182:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789127207.106615:0:25262:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1789127207.106624:0:25262:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789127207.106733:0:25262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:24191:x1876035276887040:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6579us (6944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127207.106744:0:25262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127207.106850:0:24191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24191:1876035276887040:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789127207.106863:0:24191:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789127207.106900:0:24191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24191:1876035276887168:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789127207.106931:0:24191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127207.106962:0:24191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127207.107007:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276887168 00000100:00100000:1.0:1789127207.107014:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276887168 00000100:00100000:1.0:1789127207.107063:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127207.107073:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24191:x1876035276887168:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789127207.107097:0:24960:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789127207.107151:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24191:x1876035276887168:12345-0@lo:5:osp-pre-0-1.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127207.107158:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127207.107199:0:24191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24191:1876035276887168:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789127207.107208:0:24191:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789127207.107229:0:24191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24191:1876035276887296:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789127207.107260:0:24191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127207.107279:0:24191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127207.107538:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276887296 00000100:00100000:3.0:1789127207.107543:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276887296 00000100:00100000:3.0:1789127207.107633:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127207.107640:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24191:x1876035276887296:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789127207.107686:0:24959:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1789127207.140782:0:24954:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1789127207.140804:0:24954:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789127207.141866:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:24191:x1876035276887296:12345-0@lo:5:osp-pre-0-1.0 Request processed in 34221us (34599us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789127207.141879:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127207.141934:0:24191:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789127207.141947:0:24191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24191:1876035276887296:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789127207.141968:0:24191:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1789127207.142018:0:24191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24191:1876035276887424:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789127207.142054:0:24191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127207.142075:0:24191:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127207.142102:0:23459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276887424 00000100:00100000:1.0:1789127207.142108:0:23459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276887424 00000100:00100000:1.0:1789127207.148272:0:23459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127207.148285:0:23459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24191:x1876035276887424:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789127207.148376:0:23459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104061680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24191:x1876035276887424:12345-0@lo:900:osp-pre-0-1.0 Request processed in 93us (6320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127207.148383:0:23459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789127207.148430:0:24191:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9941040621c0 x1876035276887424/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127223 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127207.148445:0:24191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24191:1876035276887424:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789127208.108066:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e857840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276887552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127208.108146:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127208.108193:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127208.108207:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276887552 00000100:00100000:2.0:1789127208.108214:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276887552 00000100:00100000:2.0:1789127208.108257:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127208.108266:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276887552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127208.108297:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789127208.108340:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276887552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127208.108348:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127208.108389:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e857840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276887552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127208.109709:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e857840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276887680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127208.109764:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127208.109869:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276887680 00000100:00100000:3.0:1789127208.109876:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276887680 00000100:00100000:3.0:1789127208.109924:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127208.109933:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276887680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127208.109961:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127208.110007:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276887680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127208.110013:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789127208.110025:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e857840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276887680:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789127209.132778:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789127209.656964:0:25776:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789127209.656968:0:25776:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789127209.656970:0:25776:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789127209.657081:0:25776:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99423cb1b800 00000020:01000004:3.0:1789127209.657107:0:25776:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789127209.657122:0:25776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789127209.657135:0:25776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff994212210000) 00000020:00000080:3.0:1789127209.657153:0:25776:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789127209.716529:0:25776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789127209.719511:0:25776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789127209.720478:0:25776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789127209.720790:0:25776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789127209.721158:0:25776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789127209.721419:0:25776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789127209.721611:0:25776:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1789127209.731701:0:25776:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789127209.731920:0:25776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789127209.731946:0:25776:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789127209.731960:0:25776:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa840b4da666ec758 00000020:01000004:1.0:1789127209.731967:0:25776:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789127209.731989:0:25776:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.123@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789127209.731992:0:25776:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789127209.731998:0:25776:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789127209.732030:0:25776:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789127209.732034:0:25776:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789127209.751922:0:25776:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789127209.751964:0:25776:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.123@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789127209.751969:0:25776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789127209.751972:0:25776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127209.751973:0:25776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127209.751974:0:25776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127209.751975:0:25776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127209.751977:0:25776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127209.751978:0:25776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127209.751984:0:25776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127209.751985:0:25776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127209.751989:0:25776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789127209.751991:0:25776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789127209.751992:0:25776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127209.751993:0:25776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127209.751994:0:25776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127209.751995:0:25776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127209.751996:0:25776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127209.751997:0:25776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127209.751998:0:25776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127209.751999:0:25776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127209.752023:0:25776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789127209.752043:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276887808:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789127209.752191:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.752244:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127209.752309:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276887808 00000100:00100000:0.0:1789127209.752316:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276887808 00000100:00100000:0.0:1789127209.752369:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789127209.752379:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:25776:x1876035276887808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789127209.752426:0:23442:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789127209.752429:0:23442:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789127209.752433:0:23442:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789127209.753119:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:25776:x1876035276887808:12345-0@lo:253:mount.lustre.0 Request processed in 739us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127209.753128:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789127209.753249:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276887808:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789127209.753259:0:25776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789127209.753262:0:25776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127209.753263:0:25776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127209.753264:0:25776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127209.753265:0:25776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127209.753266:0:25776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127209.753267:0:25776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127209.753268:0:25776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127209.753269:0:25776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127209.753270:0:25776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789127209.753288:0:25776:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99423cb1b800 from lustre-OST0001 10000000:01000000:2.0:1789127209.753313:0:25776:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789127209.753316:0:25776:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789127209.753389:0:25776:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9942290f1a48 local copy 00010000:00010000:2.0:1789127209.753400:0:25776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127209.753498:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276887936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127209.753537:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.753610:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127209.754606:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276887936 00000100:00100000:1.0:1789127209.754615:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276887936 00000100:00100000:1.0:1789127209.754844:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789127209.754855:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:25776:x1876035276887936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127209.755241:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:25776:x1876035276887936:12345-0@lo:501:mount.lustre.0 Request processed in 387us (1702us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789127209.755250:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789127209.755339:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276887936:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789127209.755360:0:25776:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789127209.755383:0:25776:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789127209.755391:0:25776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.755400:0:25776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca800/0xa840b4da666ec392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec399 expref: -99 pid: 23426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127209.755433:0:25776:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99423cb1b800 10000000:01000000:2.0:1789127209.755443:0:25776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789127209.755448:0:25776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789127209.755451:0:25776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127209.755455:0:25776:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789127209.755458:0:25776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789127209.755486:0:25776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588800/0xa840b4da666ec75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.755494:0:25776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236588800/0xa840b4da666ec75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.755502:0:25776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236588800/0xa840b4da666ec75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127209.755518:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127209.755552:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.756235:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127209.756283:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276888064 00000100:00100000:0.0:1789127209.756289:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276888064 00000100:00100000:0.0:1789127209.756320:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789127209.756327:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:25776:x1876035276888064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127209.756337:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127209.756351:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb400/0xa840b4da666ec766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec75f expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.756373:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb400/0xa840b4da666ec766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec75f expref: 22 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.756383:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb400/0xa840b4da666ec766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec75f expref: 22 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.756391:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb400, rc 0) 00000100:00100000:0.0:1789127209.756441:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888064:12345-0@lo:101:mount.lustre.0 Request processed in 114us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127209.756448:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789127209.756586:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127209.756601:0:25776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236588800/0xa840b4da666ec75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec766 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.756611:0:25776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236588800/0xa840b4da666ec75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec766 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127209.757780:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1789127209.758920:0:25776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127209.761035:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789127209.761086:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789127209.761118:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789127209.761134:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789127209.761148:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789127209.761160:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789127209.761172:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789127209.761185:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789127209.761197:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1789127209.761376:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1789127209.761384:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1789127209.761503:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127209.761570:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.761794:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127209.761835:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276888192 00000100:00100000:1.0:1789127209.761842:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276888192 00000100:00100000:1.0:1789127209.761932:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789127209.761943:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127209.762521:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888192:12345-0@lo:501:mount.lustre.0 Request processed in 578us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127209.762529:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789127209.762601:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127209.762720:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127209.762772:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.762799:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127209.762847:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276888320 00000100:00100000:3.0:1789127209.762853:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276888320 00000100:00100000:3.0:1789127209.762891:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789127209.762899:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888320:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127209.763507:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888320:12345-0@lo:503:mount.lustre.0 Request processed in 608us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127209.763514:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789127209.763598:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888320:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127209.764127:0:25776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127209.764199:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127209.764258:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.764362:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127209.764543:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276888448 00000100:00100000:1.0:1789127209.764548:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276888448 00000100:00100000:1.0:1789127209.764637:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789127209.764645:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127209.765059:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888448:12345-0@lo:502:mount.lustre.0 Request processed in 414us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127209.765074:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789127209.765170:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127209.765365:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789127209.765390:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789127209.765416:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789127209.765430:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789127209.765441:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789127209.765451:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789127209.765463:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789127209.765476:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789127209.765490:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789127209.765513:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127209.765549:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.766044:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994103cf46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127209.766118:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276888576 00000100:00100000:0.0:1789127209.766124:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276888576 00000100:00100000:0.0:1789127209.766154:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789127209.766161:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127209.766333:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888576:12345-0@lo:502:mount.lustre.0 Request processed in 172us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127209.766348:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789127209.766771:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127209.766828:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1789127209.766839:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789127209.767600:0:25780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789127209.767609:0:25780:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789127209.767750:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127209.767753:0:25780:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789127209.767761:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127209.767776:0:25780:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff994103ec8000) 00000020:00000080:2.0:1789127209.767800:0:25780:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789127209.767805:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789127209.767890:0:25780:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99423cb1b800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789127209.767898:0:25780:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789127209.767905:0:25780:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa840b4da666ec774 00010000:00010000:2.0:1789127209.772477:0:25780:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789127209.774014:0:25780:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1789127209.776755:0:25780:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:2.0:1789127209.782844:0:25780:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789127209.782857:0:25780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127209.782865:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127209.782867:0:25780:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789127209.782871:0:25780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127209.782876:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127209.782877:0:25780:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127209.782880:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127209.782882:0:25780:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789127209.782885:0:25780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127209.782886:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127209.782887:0:25780:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789127209.782890:0:25780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127209.782892:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127209.782893:0:25780:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789127209.782896:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789127209.782917:0:25780:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127209.782919:0:25780:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127209.782921:0:25780:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789127209.782924:0:25780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1789127209.783071:0:25776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789127209.783109:0:25776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789127209.783133:0:25776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236588800/0xa840b4da666ec75f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec766 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.783146:0:25776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236588800/0xa840b4da666ec75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec766 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127209.783154:0:25776:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99423cb1b800 from 1 10000000:01000000:0.0:1789127209.783157:0:25776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127209.783192:0:25776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.783200:0:25776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.783210:0:25776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127209.783235:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888704:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127209.783300:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127209.783339:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994230a63b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127209.783364:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276888704 00000100:00100000:0.0:1789127209.783371:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276888704 00000100:00100000:0.0:1789127209.785899:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789127209.785918:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:25776:x1876035276888704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127209.785942:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127209.785960:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec77b expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.785986:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec77b expref: 23 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.785997:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec77b expref: 23 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.786006:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb200, rc 0) 00000100:00100000:0.0:1789127209.786083:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276888704:12345-0@lo:101:mount.lustre.0 Request processed in 172us (2782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127209.786092:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789127209.786308:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127209.786327:0:25776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.786338:0:25776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127209.788892:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:1.0:1789127209.789238:0:25776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127209.789472:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1789127209.789497:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1789127209.789512:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1789127209.789523:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1789127209.789533:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1789127209.789544:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1789127209.789566:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1789127209.789578:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:1.0:1789127209.789589:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:1.0:1789127209.789600:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:1.0:1789127209.789610:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:1.0:1789127209.789622:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:1.0:1789127209.789634:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:1.0:1789127209.789677:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:1.0:1789127209.789695:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:1.0:1789127209.789706:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:1.0:1789127209.789717:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:1.0:1789127209.789732:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:1.0:1789127209.789737:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:1.0:1789127209.789817:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127209.789875:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127209.789917:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127209.790072:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276888832 00000100:00100000:3.0:1789127209.790078:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276888832 00000100:00100000:3.0:1789127209.790145:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789127209.790157:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276888832:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127209.790272:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276888832:12345-0@lo:501:mount.lustre.0 Request processed in 118us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127209.790287:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789127209.790365:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127209.790399:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127209.790439:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.790499:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410261b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127209.791058:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276888960 00000100:00100000:3.0:1789127209.791063:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276888960 00000100:00100000:3.0:1789127209.791103:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789127209.791110:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276888960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127209.791201:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276888960:12345-0@lo:503:mount.lustre.0 Request processed in 91us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127209.791208:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789127209.791283:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276888960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127209.791626:0:25776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127209.792797:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127209.793052:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.793107:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410261b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127209.793174:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276889088 00000100:00100000:0.0:1789127209.793180:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276889088 00000100:00100000:0.0:1789127209.793253:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789127209.793261:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276889088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127209.793367:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276889088:12345-0@lo:502:mount.lustre.0 Request processed in 106us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127209.793375:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127209.793495:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127209.793736:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789127209.793761:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789127209.793773:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789127209.793785:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789127209.793795:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789127209.793814:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789127209.793826:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789127209.793835:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:2.0:1789127209.793846:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:2.0:1789127209.793856:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:2.0:1789127209.793866:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:2.0:1789127209.793877:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:2.0:1789127209.793887:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:2.0:1789127209.793897:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:2.0:1789127209.793907:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:2.0:1789127209.793917:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:2.0:1789127209.793946:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:2.0:1789127209.793967:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127209.794003:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.794028:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410261b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127209.794161:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276889216 00000100:00100000:1.0:1789127209.794166:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276889216 00000100:00100000:1.0:1789127209.794201:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789127209.794208:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276889216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127209.794295:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276889216:12345-0@lo:502:mount.lustre.0 Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127209.794307:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789127209.794402:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127209.794443:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:2.0:1789127209.794451:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789127209.798683:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127209.798698:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798701:0:25784:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789127209.798712:0:25784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99423cb1b800 00000020:00000080:1.0:1789127209.798715:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127209.798723:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127209.798726:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798727:0:25784:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789127209.798730:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127209.798732:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798734:0:25784:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127209.798737:0:25784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99423cb1b800 00000020:00000080:1.0:1789127209.798740:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127209.798789:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127209.798793:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798794:0:25784:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789127209.798798:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127209.798800:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798802:0:25784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127209.798805:0:25784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99423cb1b800 00000020:00000080:1.0:1789127209.798808:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127209.798825:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127209.798828:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798830:0:25784:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127209.798833:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127209.798836:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798837:0:25784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127209.798841:0:25784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99423cb1b800 00000020:00000080:1.0:1789127209.798843:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127209.798860:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127209.798874:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798875:0:25784:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127209.798879:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127209.798881:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798882:0:25784:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127209.798885:0:25784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99423cb1b800 00000020:00000080:1.0:1789127209.798887:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127209.798904:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127209.798907:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798908:0:25784:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127209.798911:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127209.798913:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798915:0:25784:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789127209.798918:0:25784:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99423cb1b800 00000020:00000080:1.0:1789127209.798920:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127209.798939:0:25784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127209.798942:0:25784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127209.798943:0:25784:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789127209.798947:0:25784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:0.0:1789127209.799172:0:25776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789127209.799199:0:25776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127209.799222:0:25776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.799233:0:25776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127209.799296:0:25776:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789127209.799299:0:25776:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99423cb1b800 10000000:01000000:0.0:1789127209.799302:0:25776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99423cb1b800 10000000:01000000:0.0:1789127209.799307:0:25776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127209.799313:0:25776:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99423cb1b800 from 1 10000000:01000000:0.0:1789127209.799316:0:25776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127209.799350:0:25776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cb800/0xa840b4da666ec789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.799359:0:25776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364cb800/0xa840b4da666ec789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.799369:0:25776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364cb800/0xa840b4da666ec789 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127209.799393:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105018780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127209.799455:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127209.799492:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994205268cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127209.802440:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276889344 00000100:00100000:3.0:1789127209.802454:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276889344 00000100:00100000:3.0:1789127209.802509:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789127209.802518:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276889344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127209.802536:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127209.802553:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212167200/0xa840b4da666ec790 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec789 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127209.802580:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212167200/0xa840b4da666ec790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec789 expref: 24 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127209.802592:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212167200/0xa840b4da666ec790 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec789 expref: 24 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127209.802601:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167200, rc 0) 00000100:00100000:3.0:1789127209.802754:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889344:12345-0@lo:101:mount.lustre.0 Request processed in 237us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127209.802761:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789127209.803334:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105018780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127209.803353:0:25776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364cb800/0xa840b4da666ec789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec790 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.803364:0:25776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364cb800/0xa840b4da666ec789 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec790 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127209.808022:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789127209.808620:0:25776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127209.808904:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789127209.808940:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789127209.808963:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789127209.808983:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789127209.809030:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789127209.810027:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789127209.810341:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789127209.810365:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789127209.810384:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789127209.810400:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789127209.810419:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789127209.810436:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789127209.810467:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789127209.810487:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789127209.810507:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789127209.810526:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789127209.810548:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789127209.810565:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789127209.810585:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789127209.810602:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789127209.810630:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789127209.810668:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789127209.810690:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789127209.810708:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789127209.810728:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789127209.810749:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789127209.810768:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789127209.810787:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789127209.810807:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789127209.810825:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789127209.810840:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789127209.810857:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789127209.810873:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789127209.810889:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789127209.810906:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789127209.810922:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789127209.810954:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789127209.810977:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789127209.810994:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789127209.811012:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789127209.811028:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789127209.811064:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789127209.811087:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789127209.811117:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789127209.811133:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789127209.811162:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789127209.811198:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789127209.811232:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789127209.811408:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789127209.811437:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789127209.811460:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789127209.811467:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789127209.811593:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127209.811704:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127209.811761:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127209.811906:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276889472 00000100:00100000:0.0:1789127209.811914:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276889472 00000100:00100000:0.0:1789127209.811966:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789127209.811985:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127209.812113:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889472:12345-0@lo:501:mount.lustre.0 Request processed in 130us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127209.812122:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789127209.812277:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889472:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127209.812317:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127209.812361:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127209.812390:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127209.812694:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276889600 00000100:00100000:0.0:1789127209.812699:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276889600 00000100:00100000:0.0:1789127209.812728:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789127209.812736:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127209.812817:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889600:12345-0@lo:503:mount.lustre.0 Request processed in 82us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127209.812836:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789127209.814364:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889600:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789127209.814811:0:25776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127209.814907:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127209.814969:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127209.815013:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276889728 00000100:00100000:1.0:1789127209.815018:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276889728 00000100:00100000:1.0:1789127209.815068:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789127209.815080:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127209.815190:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889728:12345-0@lo:502:mount.lustre.0 Request processed in 113us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127209.815199:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789127209.815261:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127209.815283:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127209.815448:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789127209.815475:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789127209.815489:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789127209.815501:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789127209.815513:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789127209.815525:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789127209.815538:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789127209.815552:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789127209.815565:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789127209.815578:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789127209.815590:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789127209.815603:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789127209.815614:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789127209.815627:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789127209.815670:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789127209.815687:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789127209.815701:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789127209.815716:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789127209.815730:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789127209.815747:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789127209.815762:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789127209.815779:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789127209.815796:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789127209.815814:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789127209.815826:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789127209.815839:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789127209.815852:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789127209.815866:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789127209.815878:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789127209.815890:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789127209.815914:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789127209.815939:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789127209.815952:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789127209.815963:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789127209.815975:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789127209.815986:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789127209.816000:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789127209.816013:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789127209.816028:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789127209.816042:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789127209.816055:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789127209.816068:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789127209.816082:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789127209.816108:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789127209.816129:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789127209.816144:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789127209.816170:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789127209.816187:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789127209.816224:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127209.816270:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127209.816317:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127209.816319:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276889856 00000100:00100000:2.0:1789127209.816325:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276889856 00000100:00100000:2.0:1789127209.816515:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789127209.816526:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127209.816630:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889856:12345-0@lo:502:mount.lustre.0 Request processed in 106us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.816637:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789127209.817416:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127209.817614:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789127209.817716:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789127209.817748:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127209.817798:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127209.817942:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127209.818469:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276889984 00000100:00100000:2.0:1789127209.818476:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276889984 00000100:00100000:2.0:1789127209.818524:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789127209.818536:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127209.818670:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276889984:12345-0@lo:502:mount.lustre.0 Request processed in 113us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.818677:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127209.818683:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276889984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127209.818738:0:25776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789127209.818749:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789127209.819600:0:25790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789127209.819616:0:25790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff994103ecced8) 00000020:00000080:2.0:1789127209.819638:0:25790:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789127209.819914:0:25790:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99423cb1b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127209.819919:0:25790:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99423cb1b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127209.819922:0:25790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99423cb1b800 3 00010000:00080000:2.0:1789127209.819959:0:25790:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994102c46000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:2.0:1789127209.822625:0:25790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789127209.824726:0:25790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789127209.824769:0:25790:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127209.824781:0:25790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa840b4da666ec79e 00000100:00080000:2.0:1789127209.824790:0:25790:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127209.824796:0:25790:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994102c46000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:2.0:1789127209.824829:0:25790:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99423e856d00 x1876035276890112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127209.824860:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276890112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127209.824920:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.824975:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276890112 00000100:00100000:2.0:1789127209.824981:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276890112 00000100:00100000:2.0:1789127209.825010:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127209.825017:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e855680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876035276890112:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127209.825038:0:23448:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:2.0:1789127209.825075:0:23448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa840b4da666ec7a5 00000004:00100000:2.0:1789127209.825089:0:23448:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127209.825143:0:23448:0:(import.c:65:import_set_state_nolock()) ffff994104aec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127209.825189:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e855680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876035276890112:12345-0@lo:38:llog_process_th.0 Request processed in 170us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.825196:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789127209.825231:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99423e856d00 x1876035276890112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127209.825240:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127209.825247:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789127209.825258:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789127209.825261:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127209.825264:0:3638:0:(import.c:65:import_set_state_nolock()) ffff994102c46000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127209.825269:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423e856d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1876035276890112:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789127209.825285:0:25790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789127209.825397:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1789127209.825397:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276890240:0@lo:400:kworker.0 00000100:00080000:3.0:1789127209.825406:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789127209.825408:0:8:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127209.825412:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 632 00000100:00080000:3.0:1789127209.825415:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789127209.825418:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422d543000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127209.825434:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994219ee21c0 x1876035276890496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127209.825464:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127209.825468:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789127209.825469:0:8:0:(import.c:65:import_set_state_nolock()) ffff9941032b7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127209.825472:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:3.0:1789127209.825475:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789127209.825478:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9941032b7800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:3.0:1789127209.825487:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994219ee0000 x1876035276891008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127209.825555:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.825579:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276890880:0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.825602:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.825628:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789127209.825633:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276890752:0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.825682:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127209.825686:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276890880 00000100:00100000:3.0:1789127209.825692:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276890880 00000100:00100000:2.0:1789127209.825704:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276891392:0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.825730:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.825763:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276890368:0@lo:400:kworker.0 00000100:00100000:3.0:1789127209.825766:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127209.825789:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276890880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.825793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.825817:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276891136:0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.825854:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127209.825855:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276890880:12345-0@lo:400:kworker.0 Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127209.825864:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127209.825881:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789127209.825883:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276890368 00000100:00100000:3.0:1789127209.825888:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276890368 00000100:00100000:2.0:1789127209.825890:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276890624:0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.825920:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127209.825925:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127209.825935:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e855e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276890368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.825942:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276891264:0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.825971:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.826003:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276890240 00000100:00100000:2.0:1789127209.826012:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276890240 00000100:00100000:3.0:1789127209.826016:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e855e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276890368:12345-0@lo:400:kworker.0 Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127209.826025:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127209.826047:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276890752 00000100:00100000:2.0:1789127209.826051:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276890752 00000100:00100000:2.0:1789127209.826065:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789127209.826071:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e856d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276890240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.826116:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e856d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276890240:12345-0@lo:400:kworker.0 Request processed in 45us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.826122:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789127209.826134:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789127209.826140:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e855a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276890752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.826167:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e855a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276890752:12345-0@lo:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.826173:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789127209.826205:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127209.826216:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276891392 00000100:00100000:2.0:1789127209.826219:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276891392 00000100:00100000:2.0:1789127209.826250:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276891136 00000100:00100000:2.0:1789127209.826253:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276891136 00000100:00100000:2.0:1789127209.826264:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276890624 00000100:00100000:2.0:1789127209.826266:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276890624 00000100:00100000:2.0:1789127209.826275:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276891264 00000100:00100000:2.0:1789127209.826277:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276891264 00000100:00100000:2.0:1789127209.826292:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127209.826298:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276891392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.826327:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876035276891392:12345-0@lo:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.826333:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127209.826344:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127209.826351:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e857840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276891136:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789127209.826355:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127209.826361:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127209.826388:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e857840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276891136:12345-0@lo:400:kworker.0 Request processed in 37us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.826394:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127209.826541:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127209.826549:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e856580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276890624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.826581:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e856580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276890624:12345-0@lo:400:kworker.0 Request processed in 33us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.826587:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127209.826598:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789127209.826604:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e856940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276891264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.826630:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e856940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276891264:12345-0@lo:400:kworker.0 Request processed in 26us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.826635:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789127209.826836:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ee1e00 x1876035276890624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127209.826849:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276890624:0@lo:400:kworker.0 00010000:00080000:2.0:1789127209.826863:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ee3c00 x1876035276891264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127209.826872:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276891264:0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.826886:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276890368:0@lo:400:kworker.0 00010000:00080000:2.0:1789127209.826896:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ee1a40 x1876035276891136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127209.826904:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276891136:0@lo:400:kworker.0 00000100:00100000:3.0:1789127209.827046:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276890496:0@lo:8:kworker.0 00000100:00100000:3.0:1789127209.827242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127209.827284:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276891008:0@lo:8:kworker.0 00000100:00100000:2.0:1789127209.827312:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276890496 00000100:00100000:3.0:1789127209.827318:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.827319:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276890496 00000100:00100000:2.0:1789127209.827343:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276891008 00000100:00100000:2.0:1789127209.827345:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276891008 00000100:00100000:2.0:1789127209.827360:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127209.827366:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276890496:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789127209.827391:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276890752:0@lo:400:kworker.0 00010000:00080000:3.0:1789127209.827410:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994219ec6580 x1876035276891392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127209.827420:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1876035276891392:0@lo:400:kworker.0 00000100:00100000:3.0:1789127209.827432:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276890880:0@lo:400:kworker.0 00000100:00100000:3.0:1789127209.827465:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276890240:0@lo:400:kworker.0 00000100:00100000:2.0:1789127209.827543:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276890496:12345-0@lo:8:kworker.0 Request processed in 175us (301us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789127209.827550:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127209.827563:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127209.827567:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276891008:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789127209.827598:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276891008:12345-0@lo:8:kworker.0 Request processed in 29us (283us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789127209.827603:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127209.827684:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127209.827691:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127209.827696:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789127209.827700:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276890496:0@lo:8:kworker.0 00000100:00100000:3.0:1789127209.827713:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127209.827716:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127209.827719:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789127209.827723:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276891008:0@lo:8:kworker.0 00000020:01000004:1.0:1789127209.828806:0:25790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789127209.828823:0:25790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9942313f8000) 00000020:00000080:1.0:1789127209.828846:0:25790:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789127209.828931:0:25790:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99423cb1b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789127209.828936:0:25790:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99423cb1b800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789127209.828938:0:25790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99423cb1b800 3 00010000:00080000:1.0:1789127209.828966:0:25790:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99421fceb000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.123@tcp at head 00010000:00010000:1.0:1789127209.832727:0:25790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789127209.832963:0:25790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789127209.833085:0:25790:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789127209.833112:0:25790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xa840b4da666ec7b3 00000100:00080000:1.0:1789127209.833124:0:25790:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127209.833130:0:25790:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99421fceb000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:1.0:1789127209.833168:0:25790:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994104062d00 x1876035276891520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127209.833193:0:25790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789127209.833215:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276891520:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127209.833283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.833847:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276891520 00000100:00100000:2.0:1789127209.833855:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276891520 00000100:00100000:2.0:1789127209.833888:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127209.833895:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1876035276891520:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127209.833920:0:24979:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 635 last 0 00000020:00000080:2.0:1789127209.833949:0:24979:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xa840b4da666ec7ba 00000004:00100000:2.0:1789127209.833965:0:24979:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127209.833996:0:24979:0:(import.c:65:import_set_state_nolock()) ffff994104aef000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127209.834054:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876035276891520:12345-0@lo:38:llog_process_th.0 Request processed in 159us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.834062:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789127209.834127:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994104062d00 x1876035276891520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127209.834137:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127209.834145:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789127209.834152:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789127209.834156:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789127209.834158:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99421fceb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127209.834165:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104062d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1876035276891520:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789127209.835563:0:25790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789127209.835827:0:25776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789127209.835860:0:25776:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789127209.835884:0:25776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cb800/0xa840b4da666ec789 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec790 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.835895:0:25776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364cb800/0xa840b4da666ec789 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec790 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789127209.835956:0:25776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789127209.835959:0:25776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127209.835960:0:25776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127209.835961:0:25776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127209.835962:0:25776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127209.835964:0:25776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127209.835965:0:25776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127209.835967:0:25776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127209.835968:0:25776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789127209.835971:0:25776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789127209.835974:0:25776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789127209.835976:0:25776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127209.835977:0:25776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127209.835978:0:25776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127209.835979:0:25776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127209.835980:0:25776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127209.835986:0:25776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127209.835987:0:25776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127209.835987:0:25776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789127209.836116:0:25776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789127209.836133:0:25776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276891648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789127209.836194:0:25776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.836237:0:25776:0:(client.c:2715:ptlrpc_set_wait()) set ffff994234620240 going to sleep for 11 seconds 00000100:00100000:2.0:1789127209.836264:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276891648 00000100:00100000:2.0:1789127209.836270:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276891648 00000100:00100000:2.0:1789127209.836329:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789127209.836338:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:25776:x1876035276891648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789127209.836499:0:23442:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789127209.836510:0:23442:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789127209.837753:0:23442:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789127209.837763:0:23442:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789127209.837813:0:23463:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789127209.837818:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789127209.837837:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.837853:0:23463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec64e expref: 24 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.837876:0:23463:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec65c expref: 24 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.837889:0:23463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.838210:0:23463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec65c expref: 24 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.838247:0:23463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec65c expref: 24 pid: 23441 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127209.838261:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276891776:0@lo:104: 00000100:00100000:2.0:1789127209.838316:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127209.838592:0:23431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276891776 00000100:00100000:0.0:1789127209.838599:0:23431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276891776 00000100:00100000:0.0:1789127209.838668:0:23431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127209.838678:0:23431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276891776:12345-0@lo:104: 00010000:00010000:0.0:1789127209.838690:0:23431:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127209.838751:0:23431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127209.838758:0:23431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276891776:12345-0@lo:104: Request processed in 83us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127209.838766:0:23431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789127209.838770:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127209.838779:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127209.838789:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589c00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:3.0:1789127209.838794:0:25263:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127209.838803:0:25263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127209.838810:0:25263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127209.838816:0:25263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127209.838853:0:25263:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127209.838861:0:25263:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127209.838881:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127209.838888:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236589c00/0xa840b4da666ec65c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec663 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127209.838900:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127209.838902:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127209.838905:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127209.838905:0:23463:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec64e expref: 24 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.838918:0:23463:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec64e expref: 24 pid: 23439 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127209.838921:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3640:1876035276891904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127209.838938:0:23463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276892032:0@lo:104: 00000100:00100000:3.0:1789127209.838961:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.838974:0:23463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.839119:0:23463:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942346206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127209.839138:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276891776:0@lo:104: 00000100:00100000:2.0:1789127209.839163:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276891904 00000100:00100000:2.0:1789127209.839167:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276891904 00010000:00010000:2.0:1789127209.839186:0:24204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec65c expref: 25 pid: 23441 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127209.839211:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127209.839280:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+25:3640:x1876035276891904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127209.839293:0:24204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127209.839299:0:24204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec65c expref: 25 pid: 23441 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.839310:0:24204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec65c expref: 25 pid: 23441 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.839331:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148f800/0xa840b4da666ec663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec65c expref: 25 pid: 23441 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.839343:0:24204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127209.839495:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3640:x1876035276891904:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.839502:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127209.839526:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276892032 00000100:00100000:2.0:1789127209.839530:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276892032 00000100:00100000:2.0:1789127209.839565:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127209.839573:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276892032:12345-0@lo:104: 00010000:00010000:2.0:1789127209.839583:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.839621:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127209.839626:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:23463:x1876035276892032:12345-0@lo:104: Request processed in 55us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.839632:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789127209.839668:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127209.839673:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.839680:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589a00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789127209.839682:0:23436:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.839690:0:23436:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127209.839707:0:23436:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127209.839713:0:23436:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127209.839738:0:23436:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.839745:0:23436:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127209.839762:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.839770:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff994236589a00/0xa840b4da666ec64e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec655 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.839785:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127209.839787:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127209.839790:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127209.839807:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276892160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127209.839837:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127209.839997:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276892160 00000100:00100000:2.0:1789127209.840072:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276892160 00010000:00010000:2.0:1789127209.840091:0:23434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec64e expref: 24 pid: 23439 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127209.840131:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127209.840139:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3641:x1876035276892160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127209.840146:0:23434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127209.840151:0:23434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec64e expref: 24 pid: 23439 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840166:0:23434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec64e expref: 24 pid: 23439 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840179:0:23434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840188:0:23434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789127209.840201:0:23434:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006293340s 00010000:00010000:2.0:1789127209.840205:0:23434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840211:0:23434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840228:0:23434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840234:0:23434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840240:0:23434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127209.840244:0:23434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840251:0:23434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840260:0:23434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840276:0:23434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127209.840316:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3641:x1876035276892160:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.840323:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127209.840579:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3640:1876035276891904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127209.840629:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276892160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127209.840718:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:25776:x1876035276891648:12345-0@lo:253:mount.lustre.0 Request processed in 4381us (4522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127209.840728:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789127209.840747:0:25776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:25776:1876035276891648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789127209.840760:0:25776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789127209.840763:0:25776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789127209.840765:0:25776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789127209.840767:0:25776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127209.840769:0:25776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127209.840770:0:25776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127209.840772:0:25776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127209.840774:0:25776:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127209.840777:0:25776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:2.0:1789127209.840777:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3e00/0xa840b4da666ec655 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec64e expref: 22 pid: 23439 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127209.840781:0:25776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1789127209.840793:0:23463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23463:1876035276892032:0@lo:104: 00000020:02000000:3.0:1789127209.840798:0:25776:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789127209.840812:0:23463:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840822:0:23463:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840827:0:23463:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127209.840833:0:23463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994236589e00/0xa840b4da666ec7c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789127209.842502:0:25776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789127209.845979:0:25776:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789127209.845997:0:25776:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789127209.846036:0:25776:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789127209.846202:0:25776:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.123@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789127209.846390:0:25776:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789127209.846412:0:25776:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789127209.847261:0:25776:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127209.847670:0:25776:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127210.154931:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789127210.670878:0:25845:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127210.671132:0:25845:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127211.194247:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127211.194390:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127211.194410:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276892288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127211.194478:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127211.194530:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276892288 00000100:00100000:3.0:1789127211.194536:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276892288 00000100:00100000:3.0:1789127211.194595:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127211.194605:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276892288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127211.194631:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789127211.194692:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276892288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127211.194700:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127211.194744:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276892288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789127211.196211:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1789127211.434806:0:23444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789127211.434813:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99422043b000 from 14 10000000:01000000:2.0:1789127211.434819:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789127211.434883:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589000/0xa840b4da666ec7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.434895:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994236589000/0xa840b4da666ec7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127211.434906:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994236589000/0xa840b4da666ec7c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127211.434942:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276892416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127211.435015:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127211.435067:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994234620300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127211.435135:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276892416 00000100:00100000:0.0:1789127211.435142:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276892416 00000100:00100000:0.0:1789127211.435197:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789127211.435216:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:23444:x1876035276892416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127211.435229:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127211.435244:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9942364caa00/0xa840b4da666ec7cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec7c8 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.435265:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9942364caa00/0xa840b4da666ec7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec7c8 expref: 23 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.435275:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9942364caa00/0xa840b4da666ec7cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec7c8 expref: 23 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.435283:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364caa00, rc 0) 00000100:00100000:0.0:1789127211.435330:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276892416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.435337:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789127211.435384:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276892416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127211.435398:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994236589000/0xa840b4da666ec7c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec7cf expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.435406:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994236589000/0xa840b4da666ec7c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec7cf expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.435459:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276892544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789127211.435489:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.435501:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127211.435863:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276892544 00000100:00100000:2.0:1789127211.435868:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276892544 00000100:00100000:2.0:1789127211.435907:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789127211.435915:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276892544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789127211.435941:0:23441:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127211.435958:0:23441:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127211.435962:0:23441:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789127211.436040:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276892544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127211.436048:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789127211.436162:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276892544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789127211.436232:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127211.436239:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994236589000/0xa840b4da666ec7c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec7cf expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.436248:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994236589000/0xa840b4da666ec7c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec7cf expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127211.436257:0:23444:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789127211.436259:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff994103e26000 from 14 10000000:01000000:0.0:1789127211.436262:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127211.436280:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ec7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.436287:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ec7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.436296:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ec7d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.436309:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276892672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127211.436337:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.436365:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127211.436381:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276892672 00000100:00100000:0.0:1789127211.436391:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276892672 00000100:00100000:0.0:1789127211.436418:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789127211.436425:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276892672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127211.436433:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127211.436455:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99423cbe0200/0xa840b4da666ec7dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666ec7d6 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.436473:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99423cbe0200/0xa840b4da666ec7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666ec7d6 expref: 24 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.436484:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99423cbe0200/0xa840b4da666ec7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec7d6 expref: 24 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.436491:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe0200, rc 0) 00000100:00100000:0.0:1789127211.436522:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104822450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:23444:x1876035276892672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.436528:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789127211.436554:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276892672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127211.436576:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ec7d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec7dd expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.436583:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ec7d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666ec7dd expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127211.436626:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276892800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789127211.436680:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127211.436698:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99423d29a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127211.436708:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276892800 00000100:00100000:0.0:1789127211.436717:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276892800 00000100:00100000:0.0:1789127211.436737:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789127211.436743:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:23444:x1876035276892800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789127211.436752:0:23439:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127211.436762:0:23439:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127211.436764:0:23439:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789127211.436821:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:23444:x1876035276892800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127211.436828:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789127211.436854:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941050183c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276892800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789127211.436892:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127211.436898:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ec7d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec7dd expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127211.436905:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff9942364cae00/0xa840b4da666ec7d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666ec7dd expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127212.202774:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127212.205774:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276892928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127212.205842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127212.205916:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276892928 00000100:00100000:1.0:1789127212.205923:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276892928 00000100:00080000:3.0:1789127212.205978:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127212.205991:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127212.206002:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276892928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127212.206027:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789127212.206089:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104060780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276892928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127212.206097:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127212.206162:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276892928:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789127212.524878:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789127213.236785:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276893056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127213.236851:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127213.236901:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127213.236911:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276893056 00000100:00100000:1.0:1789127213.236918:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276893056 00000100:00100000:1.0:1789127213.236959:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789127213.236968:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276893056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127213.237003:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789127213.237054:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104061a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276893056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127213.237062:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789127213.237586:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276893184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127213.237630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127213.239930:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276893184 00000100:00100000:1.0:1789127213.239945:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276893184 00000100:00100000:1.0:1789127213.239991:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127213.240001:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276893184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127213.240039:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127213.240248:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276893184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 248us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127213.240257:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127213.240326:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276893056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127213.242809:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276893184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789127214.251813:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127214.252728:0:24206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127215.274823:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127215.274995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127215.275000:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789127215.275004:0:37:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127215.275015:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99422d543000 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127215.275037:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488ed00 x1876035276893696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127215.275085:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127215.275089:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789127215.275090:0:37:0:(import.c:65:import_set_state_nolock()) ffff9941032b7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127215.275103:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9941032b7800 using connection 192.168.203.123@tcp/0@lo 00000100:00100000:0.0:1789127215.275116:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99410488cf00 x1876035276894208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127215.275184:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276893824:0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.275258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127215.275296:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276894464:0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.275320:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127215.275352:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789127215.275358:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276893312:0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.275391:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127215.275423:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276893952:0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.275449:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127215.275468:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276894592:0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.275473:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276893952 00000100:00100000:1.0:1789127215.275482:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276893952 00000100:00100000:0.0:1789127215.275491:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127215.275529:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127215.275538:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276893952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.275590:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276893952:12345-0@lo:400:kworker.0 Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127215.276053:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127215.276810:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276893696:0@lo:8:kworker.0 00000100:00100000:1.0:1789127215.276871:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127215.276905:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276894208:0@lo:8:kworker.0 00000100:00100000:1.0:1789127215.276931:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127215.277143:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276893568:0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.277177:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127215.277203:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276894336:0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.277237:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276893440:0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.277266:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127215.277351:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276894080:0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.277379:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127215.277402:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276894720:0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.277437:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276893696 00000100:00100000:1.0:1789127215.277444:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276893696 00000100:00100000:1.0:1789127215.277465:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276894208 00000100:00100000:1.0:1789127215.277468:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276894208 00000100:00100000:1.0:1789127215.277481:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276893568 00000100:00100000:1.0:1789127215.277484:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276893568 00000100:00100000:1.0:1789127215.277522:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276894080 00000100:00100000:1.0:1789127215.277526:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276894080 00000100:00100000:1.0:1789127215.277544:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127215.277553:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104062d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276893568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.277603:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104062d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276893568:12345-0@lo:400:kworker.0 Request processed in 51us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127215.277619:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127215.277634:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127215.277641:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276894080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.277708:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276894080:12345-0@lo:400:kworker.0 Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127215.277717:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127215.277718:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276893952:0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.277733:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127215.277738:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1876035276893696:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789127215.277753:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276893824 00000100:00100000:0.0:1789127215.277760:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276893824 00000100:00100000:0.0:1789127215.277788:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276894464 00000100:00100000:0.0:1789127215.277791:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276894464 00000100:00100000:0.0:1789127215.277806:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276894592 00000100:00100000:0.0:1789127215.277810:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276894592 00000100:00100000:0.0:1789127215.277828:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789127215.277829:0:24958:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000100:00100000:0.0:1789127215.277837:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276893824:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1789127215.277869:0:24958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa840b4da666ec7e4 00000100:00100000:0.0:1789127215.277884:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276893824:12345-0@lo:400:kworker.0 Request processed in 48us (2626us total) trans 0 rc 0/0 00002000:00100000:1.0:1789127215.277888:0:24958:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9941031eb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:0.0:1789127215.277893:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00002000:00080000:1.0:1789127215.277895:0:24958:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789127215.277899:0:24958:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789127215.277917:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127215.277923:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276894464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.277956:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276894464:12345-0@lo:400:kworker.0 Request processed in 33us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127215.277962:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127215.277973:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127215.277979:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276894592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.278009:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276894592:12345-0@lo:400:kworker.0 Request processed in 29us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127215.278014:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127215.278037:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276893312 00000100:00100000:0.0:1789127215.278041:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276893312 00000100:00100000:0.0:1789127215.278080:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789127215.278089:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3641:x1876035276893312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.278124:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3641:x1876035276893312:12345-0@lo:400:kworker.0 Request processed in 37us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127215.278131:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789127215.278175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127215.278216:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276894080:0@lo:400:kworker.0 00002000:00080000:1.0:1789127215.278236:0:24958:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1789127215.278239:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276894720 00000100:00100000:0.0:1789127215.278245:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276894720 00000100:00080000:1.0:1789127215.278266:0:24958:0:(import.c:65:import_set_state_nolock()) ffff9941031ed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127215.278273:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127215.278281:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276894720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127215.278385:0:25262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127215.278394:0:25262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104062580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3638:x1876035276894208:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789127215.278413:0:25262:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:2.0:1789127215.278431:0:25262:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xa840b4da666ec7eb 00000100:00100000:0.0:1789127215.278919:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276894720:12345-0@lo:400:kworker.0 Request processed in 638us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127215.278928:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789127215.278933:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876035276893696:12345-0@lo:8:kworker.0 Request processed in 1191us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127215.278946:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789127215.278982:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488d680 x1876035276894720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127215.278994:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276894720:0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.279017:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994105019e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276893312:0@lo:400:kworker.0 00010000:00080000:0.0:1789127215.279030:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488f480 x1876035276894592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127215.279038:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276894592:0@lo:400:kworker.0 00010000:00080000:0.0:1789127215.279049:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488f0c0 x1876035276893824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127215.279066:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276893824:0@lo:400:kworker.0 00010000:00080000:0.0:1789127215.279079:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488fc00 x1876035276894464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127215.279087:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276894464:0@lo:400:kworker.0 00000100:00080000:1.0:1789127215.279120:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127215.279125:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127215.279127:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127215.279142:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127215.279174:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276894848:0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.279206:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127215.279234:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276893568:0@lo:400:kworker.0 00010000:00080000:1.0:1789127215.279272:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488ed00 x1876035276893696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127215.279352:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789127215.279361:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789127215.279366:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789127215.279369:0:3638:0:(import.c:65:import_set_state_nolock()) ffff99422d543000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789127215.279384:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789127215.279389:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1876035276893696:0@lo:8:kworker.0 00000100:00100000:1.0:1789127215.279414:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276893440 00000100:00100000:1.0:1789127215.279419:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276893440 00000100:00100000:1.0:1789127215.279448:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127215.279454:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276893440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127215.279496:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276893440:12345-0@lo:400:kworker.0 Request processed in 42us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127215.279503:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789127215.279680:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276894336 00000100:00100000:0.0:1789127215.279685:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276894336 00000100:00100000:0.0:1789127215.279712:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276894848 00000100:00100000:0.0:1789127215.279715:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276894848 00000100:00100000:0.0:1789127215.279741:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127215.279747:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276894336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.279788:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276894336:12345-0@lo:400:kworker.0 Request processed in 41us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127215.279794:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127215.279805:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127215.279811:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276894848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127215.279861:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276894848:12345-0@lo:400:kworker.0 Request processed in 50us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127215.279867:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789127215.279885:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127215.280413:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276893440:0@lo:400:kworker.0 00010000:00080000:0.0:1789127215.280451:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488f840 x1876035276894336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127215.280461:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276894336:0@lo:400:kworker.0 00010000:00080000:0.0:1789127215.280474:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488da40 x1876035276894848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127215.280482:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276894848:0@lo:400:kworker.0 00002000:00100000:2.0:1789127215.281089:0:25262:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff994104ae9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113989 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789127215.281171:0:25262:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789127215.281174:0:25262:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789127215.281234:0:25262:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789127215.281267:0:25262:0:(import.c:65:import_set_state_nolock()) ffff994104ae8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127215.281334:0:25262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104062580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3638:x1876035276894208:12345-0@lo:8:kworker.0 Request processed in 2937us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127215.281343:0:25262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1789127215.281371:0:23473:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1789127215.281561:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488cf00 x1876035276894208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127215.281576:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789127215.281584:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789127215.281589:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789127215.281591:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9941032b7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789127215.281608:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789127215.281614:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1876035276894208:0@lo:8:kworker.0 00000004:00080000:2.0:1789127215.281849:0:23473:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640486199762ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789127215.281856:0:23473:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789127215.282027:0:23474:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1789127215.282049:0:23474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23474:1876035276895104:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789127215.282069:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127215.282079:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276894976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127215.282187:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127215.282232:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276894976 00000100:00100000:2.0:1789127215.282238:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276894976 00000100:00100000:2.0:1789127215.282288:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127215.282297:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276894976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127215.282320:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127215.282362:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1876035276894976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127215.282369:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789127215.282393:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789127215.282705:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ec52c0 x1876035276894976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127215.282721:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276894976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127215.283208:0:23474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127215.283234:0:23474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942367f40c0 going to sleep for 11 seconds 00000004:00080000:3.0:1789127215.283283:0:24193:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789127215.283299:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276895232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127215.283300:0:24193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24193:1876035276895360:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789127215.283328:0:24193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127215.283332:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127215.283344:0:24193:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942367f4540 going to sleep for 11 seconds 00000004:00080000:3.0:1789127215.283357:0:24192:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789127215.283611:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276895232 00000100:00100000:2.0:1789127215.283618:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276895232 00000100:00100000:2.0:1789127215.283693:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127215.283704:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1876035276895232:12345-0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1789127215.283716:0:24192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 640488066594ns, next at 0ns, rc = 0 00002000:00000024:2.0:1789127215.283721:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00080000:00080000:3.0:1789127215.283724:0:24192:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789127215.283777:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1876035276895232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127215.283784:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789127215.283825:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127215.283843:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276895104 00000100:00100000:3.0:1789127215.283848:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276895104 00010000:00080000:2.0:1789127215.283858:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ec5a40 x1876035276895232/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127215.283875:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276895232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127215.283882:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276895360 00000100:00100000:3.0:1789127215.283886:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276895360 00000100:00100000:2.0:1789127215.283905:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127215.283914:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127215.283918:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:23474:x1876035276895104:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789127215.283926:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24193:x1876035276895360:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789127215.284877:0:23427:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789127215.285634:0:24182:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1789127215.291787:0:24959:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789127215.291797:0:24959:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789127215.291890:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24193:x1876035276895360:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7962us (8557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127215.291901:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789127215.292634:0:24193:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994219ec4000 x1876035276895360/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127231 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127215.292671:0:24193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24193:1876035276895360:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789127215.292687:0:24193:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789127215.292732:0:24193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24193:1876035276895488:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789127215.292781:0:24193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127215.292806:0:24193:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127215.292827:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276895488 00000100:00100000:0.0:1789127215.292832:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276895488 00000100:00100000:0.0:1789127215.292876:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127215.292884:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24193:x1876035276895488:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789127215.292906:0:24960:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789127215.292935:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24193:x1876035276895488:12345-0@lo:5:osp-pre-1-1.0 Request processed in 52us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127215.292942:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789127215.294092:0:24193:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488f840 x1876035276895488/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127231 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127215.294105:0:24193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24193:1876035276895488:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789127215.294114:0:24193:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789127215.294146:0:24193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24193:1876035276895616:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789127215.294181:0:24193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127215.294200:0:24193:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127215.294214:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276895616 00000100:00100000:0.0:1789127215.294217:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276895616 00000100:00100000:0.0:1789127215.294249:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127215.294256:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24193:x1876035276895616:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789127215.294283:0:24959:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00080000:2.0:1789127215.297075:0:24958:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789127215.297087:0:24958:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1789127215.297094:0:24958:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00002000:00010000:1.0:1789127215.320295:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127215.320307:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320329:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1789127215.320334:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127215.320342:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320360:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320370:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320379:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320401:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127215.320415:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127215.320421:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320428:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127215.320432:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320440:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320467:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320474:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d9d7d81/0xa840b4da666ec7f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.320492:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127215.320494:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127215.320496:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127215.321166:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127215.321173:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.321444:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1789127215.321449:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127215.321456:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.321467:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.321477:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.321485:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.321522:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127215.322483:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127215.322491:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.322503:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1789127215.322507:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127215.322512:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.322523:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.322531:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.322539:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.322559:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127215.322986:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127215.322995:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323003:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148f200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.323013:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323023:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323042:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323050:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b537be57/0xa840b4da666ec7f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323079:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.323083:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323089:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99420148ea00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.323093:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323100:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323109:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323116:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096de303c/0xa840b4da666ec800 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.323136:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.323138:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.323140:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127215.323891:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127215.323899:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.323909:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1789127215.323917:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127215.323922:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.323933:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.323943:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.323950:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.324045:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127215.324067:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127215.324071:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.324079:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127215.324082:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.324089:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.324100:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.324186:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec807 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.324203:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127215.324205:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127215.324206:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.324697:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127215.328111:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127215.328123:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.328149:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=640s v=(0 0) 00010000:00010000:0.0:1789127215.328154:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127215.328160:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.328175:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.328186:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.328193:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.328211:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789127215.329358:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127215.329366:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329378:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=640s v=(0 0) 00010000:00010000:0.0:1789127215.329382:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127215.329389:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329400:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329420:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329427:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329449:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789127215.329462:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127215.329468:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329476:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe0e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.329480:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329489:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329507:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329514:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec80e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329532:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127215.329541:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329547:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.329550:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329557:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329567:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329574:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec815 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.329587:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.329589:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.329590:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127215.330691:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127215.330699:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.330710:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=640s v=(0 0) 00010000:00010000:0.0:1789127215.330714:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127215.330719:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.330743:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.330753:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.330760:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.330781:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127215.332513:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.332524:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.332536:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.332540:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.332552:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.332571:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.332579:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3fb2423/0xa840b4da666ec81c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.332598:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.332600:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.332602:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127215.333914:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127215.337705:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127215.337717:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.337733:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=640s v=(0 0) 00010000:00010000:0.0:1789127215.337738:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127215.337744:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.337758:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.337768:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.337789:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.337819:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127215.338108:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127215.338116:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.338124:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127215.338128:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.338136:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.338169:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.338176:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003059eaa2/0xa840b4da666ec823 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.338198:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.338200:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.338202:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127215.340192:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127215.340204:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.340221:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=640s v=(0 0) 00010000:00010000:0.0:1789127215.340226:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127215.340234:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.340249:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.340259:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.340266:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.340287:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127215.341905:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.341916:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.341950:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe0600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.341955:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.341965:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.341983:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.341991:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eafd18d1/0xa840b4da666ec82a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.342009:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.342011:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.342013:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127215.345531:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127215.345543:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.345559:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1789127215.345564:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127215.345570:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.345584:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.345594:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.345601:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.345625:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127215.347245:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127215.347255:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.347274:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.347279:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.347290:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.347309:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.347316:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1a16395/0xa840b4da666ec831 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.347336:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.347337:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.347339:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127215.355416:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.355427:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355444:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.355449:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.355455:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355469:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355479:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355488:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355529:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127215.355854:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.355861:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355870:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.355874:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.355879:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355889:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355897:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355905:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.355918:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789127215.356273:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.356279:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.356288:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.356297:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.356302:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.356313:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.356321:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.356329:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.356346:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789127215.356572:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789127215.356581:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356589:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.356594:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356603:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356628:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356636:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec838 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356682:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127215.356687:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356694:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.356697:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356703:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356713:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356721:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec83f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356731:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.356734:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356747:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.356750:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356758:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356767:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356773:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec846 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.356786:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.356788:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.356790:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.356798:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127215.356897:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.356903:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.356912:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.356916:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.356920:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.356930:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.356938:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.357019:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.357079:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127215.357741:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.357748:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.357758:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.357762:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.357767:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.357777:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.357785:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.357793:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.357843:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127215.357849:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.357857:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.357860:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.357879:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.357892:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.357900:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec84d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.358338:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127215.358346:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.358354:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.358358:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.358366:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.358385:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.358395:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.358397:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.358399:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.362388:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.362397:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.362402:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.362809:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789127215.362819:0:24958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e285f72e/0xa840b4da666ec854 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.363019:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127215.363463:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.363472:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.363486:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.363491:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.363498:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.363513:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.363523:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.363531:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.363557:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127215.364133:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.364140:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364150:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.364155:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364164:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364186:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364203:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006120c3fb/0xa840b4da666ec85b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364222:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.364224:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.364226:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127215.364422:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.364428:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.364438:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.364441:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.364453:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.364464:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.364472:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.364478:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.364500:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127215.364757:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.364763:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364771:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.364774:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364782:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364794:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364801:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006891b43d/0xa840b4da666ec862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.364815:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.364817:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.364818:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127215.364905:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.364911:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.364920:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.364923:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.364927:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.364936:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.365169:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.365238:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.365291:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127215.365696:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.365703:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.365713:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.365716:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.365721:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.365732:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.365740:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.365748:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127215.366404:0:25777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1789127215.366424:0:25777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789127215.366428:0:25777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789127215.366566:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:24193:x1876035276895616:12345-0@lo:5:osp-pre-1-1.0 Request processed in 72306us (72380us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789127215.366576:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127215.366629:0:24193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789127215.366638:0:24193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24193:1876035276895616:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789127215.366668:0:24193:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1789127215.366717:0:24193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24193:1876035276895744:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789127215.366751:0:24193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127215.366780:0:24193:0:(client.c:2715:ptlrpc_set_wait()) set ffff99410437b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127215.368079:0:23458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276895744 00000100:00100000:1.0:1789127215.368088:0:23458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276895744 00000100:00100000:1.0:1789127215.368130:0:23458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127215.368139:0:23458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24193:x1876035276895744:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789127215.368223:0:23458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24193:x1876035276895744:12345-0@lo:900:osp-pre-1-1.0 Request processed in 85us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127215.368231:0:23458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789127215.368270:0:24193:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99410488f840 x1876035276895744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127231 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127215.368282:0:24193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24193:1876035276895744:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1789127215.369819:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127215.369830:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.369843:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.369848:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.369860:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.369881:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.369889:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d042c7de/0xa840b4da666ec869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.369905:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.369909:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.369916:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236588400 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.369919:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.369927:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.369951:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.369958:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.369959:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.369962:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.373945:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789127215.373960:0:24958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043f93dcf/0xa840b4da666ec870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.374263:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127215.374549:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.374557:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.374571:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.374575:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.374582:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.374595:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.374605:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.374612:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.374714:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127215.375003:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.375010:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.375018:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.375021:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.375032:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.375042:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.375050:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.375068:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375811:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127215.375820:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375831:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.375835:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375852:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375870:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375877:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec7e2e8c/0xa840b4da666ec877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375898:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127215.375903:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375909:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.375912:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375920:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375929:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.375936:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.375938:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.375945:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.375999:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789127215.376005:0:24958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021eb177a/0xa840b4da666ec87e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.376354:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127215.376441:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.376447:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.376457:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.376461:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.376466:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.376477:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.376498:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.376505:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.376525:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127215.376799:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127215.376806:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.376815:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.376819:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.376828:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.376842:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.376849:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9497ef6/0xa840b4da666ec885 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.376867:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.376869:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.376871:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127215.376961:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.376967:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.376975:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.376978:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.376982:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.376991:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.376999:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.377006:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.377073:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127215.377365:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.377371:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.377380:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.377383:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.377387:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.377396:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.377404:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.377411:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1789127215.378146:0:26135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg323-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789127215.379236:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127215.379248:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.379260:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.379265:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.379293:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.379315:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.379322:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bca603bb/0xa840b4da666ec88c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.379348:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127215.379353:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.379360:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.379364:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.379371:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.379381:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.379388:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.379390:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.379397:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.380313:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789127215.380326:0:24958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b910a79/0xa840b4da666ec893 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127215.382101:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.382114:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.382136:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.382140:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.382147:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.382161:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.382173:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.382248:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.383313:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.383323:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.383333:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.383338:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.383347:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.383367:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.383378:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.383380:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.383382:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.385326:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789127215.385341:0:24958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec89a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127215.387022:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.387033:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.387048:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.387053:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.387071:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.387104:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.387115:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.387122:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.387410:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127215.387418:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.387427:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.387431:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.387441:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.387458:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.387466:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.387468:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.387470:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.389873:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789127215.389888:0:24958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c3ed348/0xa840b4da666ec8a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127215.390378:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.390385:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390399:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.390403:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.390409:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390423:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390445:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390453:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390472:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127215.390484:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127215.390490:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390497:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127215.390501:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390510:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390527:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390534:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b5faad6/0xa840b4da666ec8a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.390549:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.390558:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127215.390560:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127215.390857:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127215.392341:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.392352:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.392367:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.392372:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.392388:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.392403:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.392414:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.392422:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.392440:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127215.393603:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127215.393612:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.393624:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789127215.393628:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127215.393634:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.393678:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.393688:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.393697:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127215.393718:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789127215.394108:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127215.394116:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.394125:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031600 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127215.394129:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.394138:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.394167:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.394176:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc8ac814/0xa840b4da666ec8af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.394763:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.394770:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.394786:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200031200 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.394790:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.394798:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.394810:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.394817:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff8a23d9/0xa840b4da666ec8b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.394836:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.394837:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.394839:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.394899:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.394901:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.394903:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127215.395818:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127215.395828:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.395841:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=640s v=(0 0) 00010000:00010000:0.0:1789127215.395845:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127215.395851:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.395863:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.395872:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.395881:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.395921:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789127215.397347:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127215.397358:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.397373:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=640s v=(0 0) 00010000:00010000:0.0:1789127215.397377:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127215.397382:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.397395:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.397404:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.397412:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.397437:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789127215.397797:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127215.397806:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397814:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1a00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127215.397818:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397827:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397844:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397863:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008df10223/0xa840b4da666ec8bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397882:0:23435:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127215.397885:0:23435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397890:0:23435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe0e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127215.397893:0:23435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397900:0:23435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397911:0:23435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397917:0:23435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006578ba3b/0xa840b4da666ec8c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127215.397929:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127215.397931:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127215.397932:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127215.397984:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127215.398074:0:24958:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127215.398080:0:24958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.398088:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=640s v=(0 0) 00010000:00010000:0.0:1789127215.398097:0:24958:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127215.398101:0:24958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.398111:0:24958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.398121:0:24958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.398128:0:24958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.398706:0:24958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789127215.398958:0:24958:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1789127215.399066:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:23474:x1876035276895104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 115140us (115845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127215.399077:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127215.402448:0:23474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23474:1876035276895104:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789127215.402467:0:23474:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789127215.402521:0:23474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23474:1876035276895872:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789127215.402578:0:23474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127215.402613:0:23474:0:(client.c:2715:ptlrpc_set_wait()) set ffff994102e09600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127215.402791:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276895872 00000100:00100000:0.0:1789127215.402798:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276895872 00000100:00100000:0.0:1789127215.402935:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127215.402944:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:23474:x1876035276895872:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789127215.402982:0:24960:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1789127215.404713:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23474:x1876035276895872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1763us (2129us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789127215.404724:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127215.404938:0:23474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23474:1876035276895872:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789127215.404953:0:23474:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1789127215.405086:0:23436:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127215.405096:0:23436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.405107:0:23436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:3.0:1789127215.405111:0:23436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.405135:0:23436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.405155:0:23436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127215.405163:0:23436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a74c2b84/0xa840b4da666ec8cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127215.405598:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.405606:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127215.405608:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789127216.254782:0:26187:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127216.255101:0:26187:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789127216.300530:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276896000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127216.300600:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127216.300673:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127216.300712:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276896000 00000100:00100000:1.0:1789127216.300719:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276896000 00000100:00100000:1.0:1789127216.300759:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127216.300767:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276896000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127216.300795:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789127216.300838:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276896000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127216.300844:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127216.300888:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276896000:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1789127217.145306:0:26237:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127217.145528:0:26237:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127217.323805:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127217.323973:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127217.324120:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276896128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127217.324200:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127217.324384:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276896128 00000100:00100000:1.0:1789127217.324392:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276896128 00000100:00100000:1.0:1789127217.324496:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127217.324507:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276896128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127217.324531:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789127217.324595:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276896128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127217.324602:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127217.324767:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276896128:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789127217.324995:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127217.364180:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.364276:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258960256 00000100:00100000:2.0:1789127217.364285:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258960256 00000100:00100000:2.0:1789127217.364398:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:2.0:1789127217.364407:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2390:x1876035258960256:12345-192.168.203.23@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789127217.364435:0:23441:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a@192.168.203.23@tcp t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:2.0:1789127217.364463:0:23441:0:(genops.c:1385:class_connect()) connect: client cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a, cookie 0xa840b4da666ec8d2 00000100:00080000:2.0:1789127217.364609:0:23441:0:(import.c:65:import_set_state_nolock()) ffff994104aee000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127217.364733:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+5:2390:x1876035258960256:12345-192.168.203.23@tcp:250:mount.lustre.0 Request processed in 324us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.364741:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 113 00000100:00100000:0.0:1789127217.368751:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.368918:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258960384 00000100:00100000:2.0:1789127217.368927:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258960384 00000100:00100000:2.0:1789127217.368992:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:2.0:1789127217.369001:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+5:18313:x1876035258960384:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789127217.369018:0:23442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127217.369035:0:23442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200030000/0xa840b4da666ec8d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c927 expref: -99 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127217.369072:0:23442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200030000/0xa840b4da666ec8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c927 expref: 6 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127217.369083:0:23442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200030000/0xa840b4da666ec8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c927 expref: 6 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127217.369092:0:23442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200030000, rc 0) 00000100:00100000:2.0:1789127217.369151:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104820050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+6:18313:x1876035258960384:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 150us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.369157:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 114 00000100:00100000:3.0:1789127217.379981:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.380057:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258960512 00000100:00100000:2.0:1789127217.380081:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258960512 00000100:00100000:2.0:1789127217.380143:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:2.0:1789127217.380153:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+6:18313:x1876035258960512:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789127217.380286:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+6:18313:x1876035258960512:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 133us (313us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127217.380294:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 115 00000100:00100000:1.0:1789127217.389881:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127217.389993:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258960640 00000100:00100000:0.0:1789127217.390003:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258960640 00000100:00100000:0.0:1789127217.390077:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:0.0:1789127217.390088:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+6:18313:x1876035258960640:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127217.390105:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127217.390123:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99423cbe0a00/0xa840b4da666ec8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c92e expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127217.390149:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99423cbe0a00/0xa840b4da666ec8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c92e expref: 7 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127217.390160:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99423cbe0a00/0xa840b4da666ec8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c92e expref: 7 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127217.390169:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe0a00, rc 0) 00000100:00100000:0.0:1789127217.390236:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104823050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+7:18313:x1876035258960640:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 150us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127217.390243:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 116 00000100:00100000:3.0:1789127217.397763:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127217.397869:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258960768 00000100:00100000:0.0:1789127217.397879:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258960768 00000100:00100000:0.0:1789127217.397942:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:0.0:1789127217.397953:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+7:18313:x1876035258960768:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789127217.398161:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18313:x1876035258960768:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 209us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127217.398170:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 117 00000100:00100000:3.0:1789127217.400375:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.400553:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258960896 00000100:00100000:2.0:1789127217.400573:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258960896 00000100:00100000:2.0:1789127217.400629:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:2.0:1789127217.400640:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18313:x1876035258960896:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789127217.400825:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104821450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18313:x1876035258960896:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 188us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.400834:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 118 00000100:00100000:1.0:1789127217.406022:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.406142:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258961024 00000100:00100000:2.0:1789127217.406152:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258961024 00000100:00100000:2.0:1789127217.406218:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:2.0:1789127217.406229:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994204959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18332:x1876035258961024:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127217.406488:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994204959850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18332:x1876035258961024:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 260us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.406496:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 119 00000100:00100000:3.0:1789127217.428557:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127217.428704:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258961152 00000100:00100000:0.0:1789127217.428714:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258961152 00000100:00100000:0.0:1789127217.428772:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:0.0:1789127217.428783:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994204958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18332:x1876035258961152:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127217.428936:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994204958050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18332:x1876035258961152:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 154us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127217.428944:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 120 00000100:00100000:3.0:1789127217.435809:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.435977:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258961280 00000100:00100000:2.0:1789127217.435996:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258961280 00000100:00100000:2.0:1789127217.436072:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:2.0:1789127217.436082:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994204959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18332:x1876035258961280:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127217.436233:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994204959050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18332:x1876035258961280:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 152us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.436247:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 121 00000100:00100000:1.0:1789127217.443489:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.443592:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258961408 00000100:00100000:2.0:1789127217.443603:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258961408 00000100:00100000:0.0:1789127217.443702:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:0.0:1789127217.443716:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+8:18313:x1876035258961408:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127217.443735:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127217.443752:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99423cbe1c00/0xa840b4da666ec8e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c95f expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127217.443778:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99423cbe1c00/0xa840b4da666ec8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c95f expref: 9 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127217.443789:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99423cbe1c00/0xa840b4da666ec8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c95f expref: 9 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127217.443799:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe1c00, rc 0) 00000100:00100000:0.0:1789127217.443871:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+9:18313:x1876035258961408:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 158us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127217.446494:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 122 00000100:00100000:3.0:1789127217.447790:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127217.447883:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258961536 00000100:00100000:0.0:1789127217.447891:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258961536 00000100:00100000:0.0:1789127217.448140:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:0.0:1789127217.448151:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+9:18313:x1876035258961536:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789127217.448185:0:23442:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789127217.448206:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789127217.448210:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789127217.448213:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789127217.448216:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789127217.448218:0:23442:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789127217.452633:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+9:18313:x1876035258961536:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 4475us (4840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127217.452671:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 123 00000100:00100000:3.0:1789127217.455295:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127217.461299:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258961664 00000100:00100000:1.0:1789127217.461313:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258961664 00000100:00100000:1.0:1789127217.461389:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:1.0:1789127217.461399:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+9:18313:x1876035258961664:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789127217.461415:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127217.465557:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c966 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127217.465600:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c966 expref: 10 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127217.465613:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c966 expref: 10 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127217.465623:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3400, rc 0) 00000100:00100000:1.0:1789127217.465713:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18313:x1876035258961664:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 4312us (10424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127217.465722:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 124 00000100:00100000:3.0:1789127217.467943:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127217.468174:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258961792 00000100:00100000:0.0:1789127217.468183:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258961792 00000100:00100000:0.0:1789127217.468276:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:0.0:1789127217.468285:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18313:x1876035258961792:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789127217.468435:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410486a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18313:x1876035258961792:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 150us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127217.468442:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 125 00000100:00100000:0.0:1789127217.473859:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127217.474150:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258961920 00000100:00100000:1.0:1789127217.474159:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258961920 00000100:00100000:1.0:1789127217.474212:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:1.0:1789127217.474221:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18313:x1876035258961920:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789127217.474542:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104869c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18313:x1876035258961920:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 254us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127217.474551:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 126 00000100:00100000:3.0:1789127217.479109:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.479257:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258962048 00000100:00100000:2.0:1789127217.479266:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258962048 00000100:00100000:2.0:1789127217.479313:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:2.0:1789127217.479322:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18336:x1876035258962048:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127217.479952:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104868c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18336:x1876035258962048:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 626us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.479963:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 127 00000100:00100000:2.0:1789127217.487704:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127217.487796:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258962176 00000100:00100000:1.0:1789127217.487805:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258962176 00000100:00100000:1.0:1789127217.487853:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:1.0:1789127217.487862:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18336:x1876035258962176:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127217.488032:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18336:x1876035258962176:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 169us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127217.488040:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 128 00000100:00100000:3.0:1789127217.494062:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127217.494175:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127217.494286:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258962304 00000100:00100000:0.0:1789127217.494295:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258962304 00000100:00100000:0.0:1789127217.494341:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258962560 00000100:00100000:0.0:1789127217.494345:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258962560 00000100:00100000:0.0:1789127217.494370:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789127217.494377:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1876035258962304:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789127217.494421:0:24979:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from ce39c917-de43-41d2-aa7b-028f64ef55d1@192.168.203.23@tcp t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:0.0:1789127217.494471:0:24979:0:(genops.c:1385:class_connect()) connect: client ce39c917-de43-41d2-aa7b-028f64ef55d1, cookie 0xa840b4da666ec8f5 00000004:00100000:0.0:1789127217.494509:0:24979:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789127217.494740:0:24979:0:(import.c:65:import_set_state_nolock()) ffff994102c57800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127217.494801:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:2390:x1876035258962304:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 423us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127217.494810:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789127217.494828:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1789127217.494832:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1876035258962560:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789127217.494848:0:24979:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from ce39c917-de43-41d2-aa7b-028f64ef55d1@192.168.203.23@tcp t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:0.0:1789127217.494889:0:24979:0:(genops.c:1385:class_connect()) connect: client ce39c917-de43-41d2-aa7b-028f64ef55d1, cookie 0xa840b4da666ec8fc 00000004:00100000:0.0:1789127217.494902:0:24979:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789127217.495034:0:24979:0:(import.c:65:import_set_state_nolock()) ffff994102c51000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127217.495071:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:2390:x1876035258962560:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 237us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127217.495077:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:3.0:1789127217.514964:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127217.515004:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127217.515036:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.515221:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258962688 00000100:00100000:2.0:1789127217.515230:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258962688 00000100:00100000:2.0:1789127217.515303:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258962432 00000100:00100000:2.0:1789127217.515306:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258962432 00000100:00100000:2.0:1789127217.515320:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258962816 00000100:00100000:2.0:1789127217.515322:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258962816 00000100:00100000:2.0:1789127217.515335:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1789127217.515345:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:0:x1876035258962688:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127217.515381:0:23447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127217.515458:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:0:x1876035258962688:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 115us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.515466:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1789127217.515482:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1789127217.515489:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:0:x1876035258962432:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127217.515505:0:23447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789127217.515548:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:0:x1876035258962432:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 59us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.515554:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1789127217.515566:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:2.0:1789127217.515573:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18313:x1876035258962816:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127217.515583:0:23447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789127217.515604:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18313:x1876035258962816:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 32us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.515610:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00080000:3.0:1789127217.516008:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127217.516013:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127217.527794:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127217.527987:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258962944 00000100:00100000:0.0:1789127217.527997:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258962944 00000100:00100000:0.0:1789127217.528073:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:0.0:1789127217.528083:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18313:x1876035258962944:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789127217.528166:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18313:x1876035258962944:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 84us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127217.528174:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 12 00000100:00100000:3.0:1789127217.538174:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127217.538272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127217.538306:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127217.538465:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258963072 00000100:00100000:2.0:1789127217.538474:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258963072 00000100:00100000:2.0:1789127217.538515:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258963200 00000100:00100000:2.0:1789127217.538519:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258963200 00000100:00100000:2.0:1789127217.538540:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:2.0:1789127217.538549:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1876035258963072:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789127217.538581:0:24958:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from ce39c917-de43-41d2-aa7b-028f64ef55d1@192.168.203.23@tcp t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:2.0:1789127217.538614:0:24958:0:(genops.c:1385:class_connect()) connect: client ce39c917-de43-41d2-aa7b-028f64ef55d1, cookie 0xa840b4da666ec903 00002000:00100000:2.0:1789127217.538625:0:24958:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ce39c917-de43-41d2-aa7b-028f64ef55d1/ffff994104aee800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789127217.538634:0:24958:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789127217.538857:0:24958:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789127217.538897:0:24958:0:(import.c:65:import_set_state_nolock()) ffff994104ae9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127217.538962:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:2390:x1876035258963072:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 412us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.538970:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:2.0:1789127217.538992:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:2.0:1789127217.538997:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1876035258963200:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789127217.539013:0:24958:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from ce39c917-de43-41d2-aa7b-028f64ef55d1@192.168.203.23@tcp t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:2.0:1789127217.539028:0:24958:0:(genops.c:1385:class_connect()) connect: client ce39c917-de43-41d2-aa7b-028f64ef55d1, cookie 0xa840b4da666ec90a 00002000:00100000:2.0:1789127217.539033:0:24958:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ce39c917-de43-41d2-aa7b-028f64ef55d1/ffff994104ae8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789127217.539054:0:24958:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789127217.539170:0:24958:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789127217.539189:0:24958:0:(import.c:65:import_set_state_nolock()) ffff994102c47000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127217.539212:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:2390:x1876035258963200:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 213us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127217.539219:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:1.0:1789127217.539796:0:23458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258963328 00000100:00100000:1.0:1789127217.539802:0:23458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258963328 00000100:00100000:1.0:1789127217.539847:0:23458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:1.0:1789127217.539854:0:23458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994209581680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18313:x1876035258963328:12345-192.168.203.23@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789127217.540058:0:23458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994209581680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18313:x1876035258963328:12345-192.168.203.23@tcp:900:mount.lustre.0 Request processed in 190us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127217.540065:0:23458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:3.0:1789127217.543463:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127217.543587:0:23450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258963456 00000100:00100000:1.0:1789127217.543596:0:23450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258963456 00000100:00100000:1.0:1789127217.543706:0:23450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1789127217.543716:0:23450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18313:x1876035258963456:12345-192.168.203.23@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789127217.546318:0:23450:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2520us 00000004:00200000:3.0:1789127217.567103:0:23450:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789127217.567239:0:23450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18313:x1876035258963456:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 23519us (23779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127217.567253:0:23450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:3.0:1789127217.724479:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127217.725236:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258963584 00000100:00100000:1.0:1789127217.725253:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258963584 00000100:00100000:1.0:1789127217.725326:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1789127217.725337:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18361:x1876035258963584:12345-192.168.203.23@tcp:101:mkdir.0 00010000:00010000:1.0:1789127217.725357:0:23449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127217.725384:0:23449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c997 expref: -99 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127217.725449:0:23449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ec918 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127217.725463:0:23449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ec918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127217.725477:0:23449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ec918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127217.725562:0:23449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789127217.725567:0:23449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127217.725604:0:23449:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ec918 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127217.725631:0:23449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c997 expref: 8 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127217.725710:0:23449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ec918 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c997 expref: 7 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127217.725718:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99420b04a000) 00010000:00010000:1.0:1789127217.725722:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127217.725724:0:23449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2800, rc 0) 00000100:00100000:1.0:1789127217.725790:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:18361:x1876035258963584:12345-192.168.203.23@tcp:101:mkdir.0 Request processed in 455us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127217.725797:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:2.0:1789127218.346938:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127218.346971:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276896256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127218.347063:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127218.347216:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127218.347380:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276896256 00000100:00100000:3.0:1789127218.347394:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276896256 00000100:00100000:3.0:1789127218.347484:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789127218.347497:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276896256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127218.347622:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127218.347755:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276896256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 260us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127218.347763:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789127218.349451:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127218.349513:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276896384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127218.349577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127218.349785:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276896256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127218.350451:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276896384 00000100:00100000:2.0:1789127218.350460:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276896384 00000100:00100000:2.0:1789127218.350516:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127218.350525:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276896384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127218.350559:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789127218.350635:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276896384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127218.350642:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127218.350832:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276896384:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789127219.371003:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127219.687408:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127219.687542:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258963712 00000100:00100000:2.0:1789127219.687557:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258963712 00000100:00080000:3.0:1789127219.687681:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127219.687719:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:2.0:1789127219.687732:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:18414:x1876035258963712:12345-192.168.203.23@tcp:41:lfs.0 00000004:00000024:2.0:1789127219.687790:0:23447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789127219.687891:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:18414:x1876035258963712:12345-192.168.203.23@tcp:41:lfs.0 Request processed in 161us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127219.687899:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:3.0:1789127219.691752:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127219.691841:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258963840 00000100:00100000:1.0:1789127219.691856:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258963840 00000100:00100000:1.0:1789127219.692017:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1789127219.692038:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18414:x1876035258963840:12345-192.168.203.23@tcp:41:lfs.0 00000004:00000024:1.0:1789127219.692093:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127219.692196:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18414:x1876035258963840:12345-192.168.203.23@tcp:41:lfs.0 Request processed in 169us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127219.692204:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00080000:3.0:1789127219.703444:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127219.703762:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127219.703843:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258963968 00000100:00100000:3.0:1789127219.703853:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258963968 00000100:00100000:3.0:1789127219.703927:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:3.0:1789127219.703938:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18414:x1876035258963968:12345-192.168.203.23@tcp:13:lfs.0 00002000:00000024:3.0:1789127219.703979:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789127219.704087:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18414:x1876035258963968:12345-192.168.203.23@tcp:13:lfs.0 Request processed in 151us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127219.704095:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00080000:0.0:1789127219.704283:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127219.710717:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127219.710833:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258964096 00000100:00100000:3.0:1789127219.710842:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258964096 00000100:00100000:3.0:1789127219.710973:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1789127219.710984:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18414:x1876035258964096:12345-192.168.203.23@tcp:13:lfs.0 00002000:00000024:3.0:1789127219.711017:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127219.711153:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18414:x1876035258964096:12345-192.168.203.23@tcp:13:lfs.0 Request processed in 171us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127219.711161:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00080000:0.0:1789127219.711214:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127219.891543:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127219.891678:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258964224 00000100:00100000:2.0:1789127219.891692:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258964224 00000100:00100000:2.0:1789127219.891772:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:2.0:1789127219.891784:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+10:18444:x1876035258964224:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789127219.891805:0:23442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127219.891829:0:23442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200031600/0xa840b4da666ec91f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c99e expref: -99 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127219.891864:0:23442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200031600/0xa840b4da666ec91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c99e expref: 11 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127219.891887:0:23442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200031600/0xa840b4da666ec91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c99e expref: 11 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127219.891898:0:23442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031600, rc 0) 00000100:00100000:2.0:1789127219.891971:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212325050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18444:x1876035258964224:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 190us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127219.891979:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 129 00000100:00100000:2.0:1789127219.901186:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127219.901298:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258964352 00000100:00100000:0.0:1789127219.901313:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258964352 00000100:00100000:0.0:1789127219.901400:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:0.0:1789127219.901412:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18444:x1876035258964352:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789127219.901580:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212325c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18444:x1876035258964352:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 169us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127219.901587:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 130 00000100:00100000:3.0:1789127219.905036:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127219.905164:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258964480 00000100:00100000:1.0:1789127219.905177:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258964480 00000100:00100000:1.0:1789127219.905255:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:1.0:1789127219.905266:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18444:x1876035258964480:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789127219.905465:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18444:x1876035258964480:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 199us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127219.905473:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 131 00000100:00100000:3.0:1789127219.914298:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127219.914485:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258964608 00000100:00100000:2.0:1789127219.914494:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258964608 00000100:00100000:2.0:1789127219.914564:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:2.0:1789127219.914594:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18453:x1876035258964608:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127219.914766:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18453:x1876035258964608:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 175us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127219.914774:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 132 00000100:00100000:2.0:1789127219.935769:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127219.936005:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258964736 00000100:00100000:0.0:1789127219.936018:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258964736 00000100:00100000:0.0:1789127219.936137:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:0.0:1789127219.936159:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18453:x1876035258964736:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127219.936354:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212325450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18453:x1876035258964736:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 206us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127219.936364:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 133 00000100:00100000:0.0:1789127219.951212:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127219.951322:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258964864 00000100:00100000:1.0:1789127219.951335:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258964864 00000100:00100000:1.0:1789127219.951410:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:1.0:1789127219.951419:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18453:x1876035258964864:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127219.951586:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212326850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18453:x1876035258964864:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 167us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127219.951594:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 134 00000100:00100000:3.0:1789127219.958631:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127219.958790:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258964992 00000100:00100000:0.0:1789127219.958803:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258964992 00000100:00100000:0.0:1789127219.958976:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00100000:0.0:1789127219.958989:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18444:x1876035258964992:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127219.959018:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127219.959050:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99423cbe0400/0xa840b4da666ec926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c9cf expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127219.959102:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99423cbe0400/0xa840b4da666ec926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9cf expref: 12 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127219.959115:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99423cbe0400/0xa840b4da666ec926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9cf expref: 12 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127219.959127:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe0400, rc 0) 00000100:00100000:0.0:1789127219.959216:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:18444:x1876035258964992:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 229us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127219.963725:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127219.963841:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258965120 00000100:00100000:2.0:1789127219.963856:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258965120 00000100:00100000:2.0:1789127219.963916:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00100000:2.0:1789127219.963926:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18444:x1876035258965120:12345-192.168.203.23@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789127219.963953:0:23442:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789127219.963980:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789127219.963984:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789127219.963987:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789127219.963990:0:23442:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789127219.963993:0:23442:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789127219.964979:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 135 00000100:00100000:2.0:1789127219.968113:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:18444:x1876035258965120:12345-192.168.203.23@tcp:256:mount.lustre.0 Request processed in 4177us (4393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127219.968127:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 136 00000100:00100000:3.0:1789127219.972790:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127219.973102:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258965248 00000100:00100000:1.0:1789127219.973116:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258965248 00000100:00100000:1.0:1789127219.973310:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 137 00000100:00100000:1.0:1789127219.973323:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:18444:x1876035258965248:12345-192.168.203.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789127219.973345:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127219.973369:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1c9d6 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127219.973424:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9d6 expref: 13 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127219.973438:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9d6 expref: 13 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127219.973450:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2400, rc 0) 00000100:00100000:1.0:1789127219.973536:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18444:x1876035258965248:12345-192.168.203.23@tcp:101:mount.lustre.0 Request processed in 215us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127219.973544:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 137 00000100:00100000:3.0:1789127219.976364:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127219.976683:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258965376 00000100:00100000:2.0:1789127219.976695:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258965376 00000100:00100000:2.0:1789127219.976761:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:2.0:1789127219.976771:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18444:x1876035258965376:12345-192.168.203.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789127219.976960:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212324050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18444:x1876035258965376:12345-192.168.203.23@tcp:501:mount.lustre.0 Request processed in 189us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127219.976968:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 138 00000100:00100000:3.0:1789127219.978959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127219.979068:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258965504 00000100:00100000:1.0:1789127219.979077:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258965504 00000100:00100000:2.0:1789127219.979180:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:2.0:1789127219.979207:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994212327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18444:x1876035258965504:12345-192.168.203.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789127219.979576:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994212327450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18444:x1876035258965504:12345-192.168.203.23@tcp:503:mount.lustre.0 Request processed in 371us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127219.979586:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 139 00000100:00100000:3.0:1789127219.982872:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127219.984432:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258965632 00000100:00100000:1.0:1789127219.984449:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258965632 00000100:00100000:1.0:1789127219.984549:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 140 00000100:00100000:1.0:1789127219.984567:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18458:x1876035258965632:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127219.984813:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18458:x1876035258965632:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 247us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127219.984822:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 140 00000100:00100000:3.0:1789127219.992103:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127219.992452:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258965760 00000100:00100000:2.0:1789127219.992465:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258965760 00000100:00100000:2.0:1789127219.992540:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:2.0:1789127219.992552:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18458:x1876035258965760:12345-192.168.203.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127219.992792:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18458:x1876035258965760:12345-192.168.203.23@tcp:502:llog_process_th.0 Request processed in 241us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127219.992801:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 141 00000100:00100000:3.0:1789127219.999814:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127219.999950:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258965888 00000100:00100000:2.0:1789127219.999963:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258965888 00000100:00100000:2.0:1789127220.000076:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:2.0:1789127220.000087:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2390:x1876035258965888:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789127220.000128:0:23447:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 20e4c89f-9d0f-4fa6-a881-4560a0c09634@192.168.203.23@tcp t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:2.0:1789127220.000179:0:23447:0:(genops.c:1385:class_connect()) connect: client 20e4c89f-9d0f-4fa6-a881-4560a0c09634, cookie 0xa840b4da666ec934 00000004:00100000:2.0:1789127220.000217:0:23447:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789127220.000376:0:23447:0:(import.c:65:import_set_state_nolock()) ffff99421fcec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127220.000481:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:2390:x1876035258965888:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 394us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.000489:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:3.0:1789127220.000645:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127220.001242:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258966144 00000100:00100000:1.0:1789127220.001506:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258966144 00000100:00100000:1.0:1789127220.001592:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1789127220.001601:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1876035258966144:12345-192.168.203.23@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789127220.001629:0:23448:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 20e4c89f-9d0f-4fa6-a881-4560a0c09634@192.168.203.23@tcp t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:1.0:1789127220.001695:0:23448:0:(genops.c:1385:class_connect()) connect: client 20e4c89f-9d0f-4fa6-a881-4560a0c09634, cookie 0xa840b4da666ec93b 00000004:00100000:1.0:1789127220.001735:0:23448:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789127220.001834:0:23448:0:(import.c:65:import_set_state_nolock()) ffff994207a0f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127220.001889:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:2390:x1876035258966144:12345-192.168.203.23@tcp:38:mount.lustre.0 Request processed in 288us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127220.001897:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:3.0:1789127220.004948:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127220.005067:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258966400 00000100:00100000:0.0:1789127220.005080:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258966400 00000100:00100000:0.0:1789127220.005225:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1789127220.005239:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:18444:x1876035258966400:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789127220.005306:0:23449:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789127220.005583:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941048092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:18444:x1876035258966400:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 347us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.005593:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00080000:3.0:1789127220.006719:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127220.011528:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127220.011587:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127220.011728:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127220.011768:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258966272 00000100:00100000:2.0:1789127220.011781:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258966272 00000100:00100000:3.0:1789127220.011850:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258966016 00000100:00100000:3.0:1789127220.011855:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258966016 00000100:00100000:0.0:1789127220.011895:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258966528 00000100:00100000:0.0:1789127220.011899:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258966528 00000100:00100000:0.0:1789127220.011929:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:0.0:1789127220.011940:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+7:0:x1876035258966016:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789127220.011984:0:23447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789127220.012083:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+7:0:x1876035258966016:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 144us (495us total) trans 0 rc 0/0 00000100:00080000:1.0:1789127220.012574:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127220.013766:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:3.0:1789127220.013793:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+7:18444:x1876035258966528:12345-192.168.203.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789127220.013971:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+7:18444:x1876035258966528:12345-192.168.203.23@tcp:40:mount.lustre.0 Request processed in 192us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.013981:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:2.0:1789127220.014486:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:2.0:1789127220.014596:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:0:x1876035258966272:12345-192.168.203.23@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127220.014631:0:23448:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127220.014707:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:0:x1876035258966272:12345-192.168.203.23@tcp:41:mount.lustre.0 Request processed in 116us (3194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.014714:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1789127220.015845:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:1.0:1789127220.020578:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127220.020626:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127220.020702:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127220.020787:0:25262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258966656 00000100:00100000:0.0:1789127220.020800:0:25262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258966656 00000100:00100000:0.0:1789127220.020847:0:25262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258966784 00000100:00100000:0.0:1789127220.020850:0:25262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258966784 00000100:00100000:0.0:1789127220.020874:0:25262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1789127220.020882:0:25262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1876035258966656:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127220.020926:0:25262:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 20e4c89f-9d0f-4fa6-a881-4560a0c09634@192.168.203.23@tcp t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:0.0:1789127220.020968:0:25262:0:(genops.c:1385:class_connect()) connect: client 20e4c89f-9d0f-4fa6-a881-4560a0c09634, cookie 0xa840b4da666ec942 00002000:00100000:0.0:1789127220.020984:0:25262:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 20e4c89f-9d0f-4fa6-a881-4560a0c09634/ffff994102c51800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127220.020999:0:25262:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127220.021101:0:25262:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789127220.021144:0:25262:0:(import.c:65:import_set_state_nolock()) ffff99421f4f3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127220.021225:0:25262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:2390:x1876035258966656:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 342us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.021234:0:25262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:0.0:1789127220.021252:0:25262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:0.0:1789127220.021258:0:25262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2390:x1876035258966784:12345-192.168.203.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127220.021285:0:25262:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 20e4c89f-9d0f-4fa6-a881-4560a0c09634@192.168.203.23@tcp t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:0.0:1789127220.021302:0:25262:0:(genops.c:1385:class_connect()) connect: client 20e4c89f-9d0f-4fa6-a881-4560a0c09634, cookie 0xa840b4da666ec949 00002000:00100000:0.0:1789127220.021307:0:25262:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 20e4c89f-9d0f-4fa6-a881-4560a0c09634/ffff994103e4e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113989 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127220.021313:0:25262:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127220.021615:0:25262:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789127220.021634:0:25262:0:(import.c:65:import_set_state_nolock()) ffff994103e4f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127220.021817:0:23459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258966912 00000100:00100000:3.0:1789127220.021823:0:23459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258966912 00000100:00100000:3.0:1789127220.021873:0:23459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1789127220.021882:0:23459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:18444:x1876035258966912:12345-192.168.203.23@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789127220.021932:0:23459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:18444:x1876035258966912:12345-192.168.203.23@tcp:900:mount.lustre.0 Request processed in 52us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.021939:0:23459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:0.0:1789127220.022277:0:25262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:2390:x1876035258966784:12345-192.168.203.23@tcp:8:mount.lustre.0 Request processed in 1009us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.022286:0:25262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1789127220.038003:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127220.038384:0:23451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258967040 00000100:00100000:0.0:1789127220.038398:0:23451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258967040 00000100:00100000:0.0:1789127220.038467:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:0.0:1789127220.038479:0:23451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:18444:x1876035258967040:12345-192.168.203.23@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789127220.038611:0:23451:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789127220.038760:0:23451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:18444:x1876035258967040:12345-192.168.203.23@tcp:33:mount.lustre.0 Request processed in 282us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.038768:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1789127220.247009:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127220.247167:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258967168 00000100:00100000:2.0:1789127220.247179:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258967168 00000100:00100000:2.0:1789127220.247252:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:2.0:1789127220.247265:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:18483:x1876035258967168:12345-192.168.203.23@tcp:101:mkdir.0 00010000:00010000:2.0:1789127220.247309:0:24979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127220.247340:0:24979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca07 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.247425:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.247441:0:24979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.247458:0:24979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127220.247519:0:24979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789127220.247524:0:24979:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127220.247576:0:24979:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.247606:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca07 expref: 8 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.247638:0:24979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca07 expref: 7 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127220.247702:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99420b04a000) 00010000:00010000:2.0:1789127220.247707:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127220.247712:0:24979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031800, rc 0) 00000100:00100000:2.0:1789127220.247796:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20e4c89f-9d0f-4fa6-a881-4560a0c09634+7:18483:x1876035258967168:12345-192.168.203.23@tcp:101:mkdir.0 Request processed in 533us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.247804:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:3.0:1789127220.395367:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127220.395399:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276896512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127220.398101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.398230:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276896640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127220.398276:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127220.398322:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127220.398351:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276896512 00000100:00100000:3.0:1789127220.398360:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276896512 00000100:00100000:3.0:1789127220.398422:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276896640 00000100:00100000:3.0:1789127220.398425:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276896640 00000100:00100000:3.0:1789127220.398447:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127220.398457:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276896512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127220.398489:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127220.398558:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276896512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.398566:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127220.398584:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127220.398591:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276896640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127220.398601:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127220.398625:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276896640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.398631:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127220.398698:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276896640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127220.398717:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276896512:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789127220.403555:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127220.403598:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276896768:0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.403716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127220.410110:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276896768 00000100:00100000:0.0:1789127220.410130:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276896768 00000100:00100000:0.0:1789127220.410333:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789127220.410347:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3641:x1876035276896768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127220.410467:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3641:x1876035276896768:12345-0@lo:400:kworker.0 Request processed in 122us (6750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127220.410475:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789127220.410792:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276897152:0@lo:400:kworker.0 00000100:00100000:3.0:1789127220.410841:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.410867:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276897664:0@lo:400:kworker.0 00000100:00100000:3.0:1789127220.410891:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.410913:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789127220.410919:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276897024:0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.413284:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276897152 00000100:00100000:2.0:1789127220.413304:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276897152 00000100:00100000:2.0:1789127220.413376:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276897664 00000100:00100000:2.0:1789127220.413379:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276897664 00000100:00100000:2.0:1789127220.413419:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127220.413430:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276897152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.413534:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876035276897152:12345-0@lo:400:kworker.0 Request processed in 107us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.413541:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127220.413560:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127220.413565:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276897664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.413592:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876035276897664:12345-0@lo:400:kworker.0 Request processed in 27us (2700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.413618:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789127220.413637:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127220.413718:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276896896:0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.413766:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.413801:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276897408:0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.413827:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.413852:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276897920:0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.413897:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.413921:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789127220.413928:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276897280:0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.413953:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.413970:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276897792:0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.413993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127220.414033:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276896896 00000100:00100000:2.0:1789127220.414038:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276896896 00000100:00100000:2.0:1789127220.414061:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276897280 00000100:00100000:2.0:1789127220.414064:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276897280 00000100:00100000:2.0:1789127220.414383:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127220.414395:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276896896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.414451:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276896896:12345-0@lo:400:kworker.0 Request processed in 60us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.414459:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127220.414472:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127220.414477:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276897280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.414503:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276897280:12345-0@lo:400:kworker.0 Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127220.414517:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276897408 00000100:00100000:2.0:1789127220.414518:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789127220.414525:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276897408 00000100:00100000:2.0:1789127220.414571:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276897280:0@lo:400:kworker.0 00000100:00100000:1.0:1789127220.414580:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127220.414588:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276896896:0@lo:400:kworker.0 00000100:00100000:1.0:1789127220.414592:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276897408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.414635:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276896768:0@lo:400:kworker.0 00000100:00100000:1.0:1789127220.414667:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276897408:12345-0@lo:400:kworker.0 Request processed in 60us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127220.414676:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127220.414689:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276897920 00000100:00100000:2.0:1789127220.414694:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276897920 00000100:00080000:1.0:1789127220.414700:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127220.414706:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127220.414722:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276897792 00000100:00100000:2.0:1789127220.414726:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276897792 00000100:00100000:2.0:1789127220.414745:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127220.414752:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276897920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.414783:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1876035276897920:12345-0@lo:400:kworker.0 Request processed in 32us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.414789:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127220.414799:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789127220.414804:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276897792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.414844:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1876035276897792:12345-0@lo:400:kworker.0 Request processed in 40us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.414851:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789127220.415107:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276897408:0@lo:400:kworker.0 00000100:00100000:1.0:1789127220.415128:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1876035276897920:0@lo:400:kworker.0 00010000:00080000:1.0:1789127220.415154:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa4c780 x1876035276897792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127220.415165:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1876035276897792:0@lo:400:kworker.0 00000100:00080000:1.0:1789127220.415192:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127220.416425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.416479:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276897536:0@lo:400:kworker.0 00000100:00100000:3.0:1789127220.416508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.416542:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276898048:0@lo:400:kworker.0 00000100:00100000:3.0:1789127220.416572:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127220.416618:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410480a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876035276897152:0@lo:400:kworker.0 00000100:00100000:3.0:1789127220.416631:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1876035276897664:0@lo:400:kworker.0 00000100:00100000:1.0:1789127220.416848:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276897536 00000100:00100000:1.0:1789127220.416856:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276897536 00000100:00100000:1.0:1789127220.417015:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276898048 00000100:00100000:1.0:1789127220.417020:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276898048 00000100:00100000:2.0:1789127220.417592:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276897024 00000100:00100000:2.0:1789127220.417598:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276897024 00000100:00100000:2.0:1789127220.417676:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127220.417689:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276897024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127220.417780:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276897024:12345-0@lo:400:kworker.0 Request processed in 94us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127220.417788:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127220.417866:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104809a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276897024:0@lo:400:kworker.0 00000100:00100000:3.0:1789127220.420922:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127220.420957:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276897536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127220.422477:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876035276897536:12345-0@lo:400:kworker.0 Request processed in 1530us (5956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.422492:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127220.422537:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127220.422551:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276898048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127220.422590:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876035276898048:12345-0@lo:400:kworker.0 Request processed in 44us (6016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127220.422596:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789127220.422747:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127220.422756:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127220.423334:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876035276897536:0@lo:400:kworker.0 00010000:00080000:2.0:1789127220.423355:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99422fa4d2c0 x1876035276898048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127220.423368:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1876035276898048:0@lo:400:kworker.0 00000001:00100000:0.0:1789127220.929965:0:25777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 20e4c89f-9d0f-4fa6-a881-4560a0c09634 00000001:00100000:0.0:1789127220.929978:0:25777:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ce39c917-de43-41d2-aa7b-028f64ef55d1 00000001:00080000:0.0:1789127220.932126:0:25777:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:1.0:1789127221.419883:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127221.424868:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276898176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127221.424950:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127221.425213:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276898176 00000100:00100000:3.0:1789127221.425220:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276898176 00000100:00100000:3.0:1789127221.425278:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127221.425288:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276898176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127221.425318:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789127221.425385:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276898176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127221.425392:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127221.425549:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276898176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127222.443338:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276898304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127222.443458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127222.443734:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127222.446638:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276898304 00000100:00100000:1.0:1789127222.446675:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276898304 00000100:00100000:1.0:1789127222.446780:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127222.446796:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276898304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127222.446836:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789127222.446964:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276898304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 174us (3506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127222.446973:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789127222.447077:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127222.447296:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276898304:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1789127222.763974:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1789127222.969517:0:23427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 20e4c89f-9d0f-4fa6-a881-4560a0c09634 00000001:00100000:1.0:1789127222.969535:0:23427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ce39c917-de43-41d2-aa7b-028f64ef55d1 00000001:00100000:2.0:1789127222.979052:0:24182:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 20e4c89f-9d0f-4fa6-a881-4560a0c09634 00000001:00100000:2.0:1789127222.979078:0:24182:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ce39c917-de43-41d2-aa7b-028f64ef55d1 00010000:00010000:3.0:1789127223.466940:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127223.477803:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276898432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127223.477905:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127223.478154:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276898432 00000100:00100000:2.0:1789127223.478163:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276898432 00000100:00100000:2.0:1789127223.478226:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127223.478237:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276898432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127223.478276:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789127223.478328:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1876035276898432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127223.478335:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789127223.478502:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104019680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1876035276898432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127223.478700:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127223.478721:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276898560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127223.478749:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127223.478772:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276898560 00000100:00100000:3.0:1789127223.478776:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276898560 00000100:00100000:3.0:1789127223.478799:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127223.478805:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276898560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127223.478822:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127223.478860:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276898560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127223.478867:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127223.478893:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276898560:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1789127223.989572:0:24954:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 20e4c89f-9d0f-4fa6-a881-4560a0c09634 00000001:00100000:3.0:1789127223.989590:0:24954:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ce39c917-de43-41d2-aa7b-028f64ef55d1 00000001:02000400:1.0:1789127224.118334:0:26335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1789127224.491469:0:24206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789127224.492349:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127225.178147:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127225.178191:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127225.178222:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127225.178244:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127225.178273:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127225.178299:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127225.178315:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127225.178330:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127225.178352:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127225.178384:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258967552 00000100:00100000:2.0:1789127225.178395:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258967552 00000100:00100000:2.0:1789127225.178472:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258968064 00000100:00100000:2.0:1789127225.178475:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258968064 00000100:00100000:2.0:1789127225.178506:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258967424 00000100:00100000:2.0:1789127225.178509:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258967424 00000100:00100000:2.0:1789127225.178522:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258967936 00000100:00100000:2.0:1789127225.178525:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258967936 00000100:00100000:2.0:1789127225.178542:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1789127225.178552:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2393:x1876035258967552:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127225.178637:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2393:x1876035258967552:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 87us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.178645:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1789127225.178683:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:2.0:1789127225.178690:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2393:x1876035258968064:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127225.178716:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2393:x1876035258968064:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.178723:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:2.0:1789127225.178734:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:2.0:1789127225.178739:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:2393:x1876035258967424:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127225.178759:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:2393:x1876035258967424:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 20us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.178765:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:2.0:1789127225.178781:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:2.0:1789127225.178786:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:2393:x1876035258967936:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127225.178805:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:2393:x1876035258967936:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 19us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.178811:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:2.0:1789127225.178827:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258967808 00000100:00100000:2.0:1789127225.178829:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258967808 00000100:00100000:2.0:1789127225.178851:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258968320 00000100:00100000:2.0:1789127225.178854:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258968320 00000100:00100000:2.0:1789127225.179031:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258967680 00000100:00100000:2.0:1789127225.179035:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258967680 00000100:00100000:2.0:1789127225.179047:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258968192 00000100:00100000:2.0:1789127225.179050:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258968192 00000100:00100000:2.0:1789127225.179065:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1789127225.179071:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2393:x1876035258967808:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127225.179101:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2393:x1876035258967808:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 30us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.179108:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:2.0:1789127225.179120:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1789127225.179126:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2393:x1876035258968320:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127225.179150:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2393:x1876035258968320:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.179157:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1789127225.179167:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1789127225.179174:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2393:x1876035258967680:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127225.179198:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2393:x1876035258967680:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 24us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.179210:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1789127225.179222:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:2.0:1789127225.179229:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2393:x1876035258968192:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127225.179255:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2393:x1876035258968192:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 27us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.179261:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00080000:2.0:1789127225.180506:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127225.180514:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127225.180518:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127225.180521:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127225.180721:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258967296 00000100:00100000:0.0:1789127225.180745:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258967296 00000100:00100000:0.0:1789127225.180801:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:0.0:1789127225.180810:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:2393:x1876035258967296:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127225.180884:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:2393:x1876035258967296:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 74us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.180892:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 143 00000100:00100000:3.0:1789127225.515034:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276898688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127225.515267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.517530:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276898816:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.517625:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127225.519428:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276898688 00000100:00100000:0.0:1789127225.519445:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276898688 00000100:00100000:0.0:1789127225.519533:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127225.519545:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276898688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127225.519586:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789127225.519687:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276898688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (4421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.519696:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127225.519732:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276898816 00000100:00100000:0.0:1789127225.519736:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276898816 00000100:00100000:0.0:1789127225.519764:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789127225.519770:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3641:x1876035276898816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127225.519805:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3641:x1876035276898816:12345-0@lo:400:kworker.0 Request processed in 35us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.519812:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789127225.520006:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3641:1876035276898816:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.520052:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276899328:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.520128:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.520163:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276899840:0@lo:400:kworker.0 00000100:00100000:2.0:1789127225.520164:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276899328 00000100:00100000:2.0:1789127225.520171:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276899328 00000100:00100000:3.0:1789127225.520195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789127225.520277:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127225.520495:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276899840 00000100:00100000:3.0:1789127225.520511:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276900352:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.520535:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.520571:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789127225.520578:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276898944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127225.520604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.520619:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276899456:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.520642:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.520681:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276899968:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.520703:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.520718:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276899840 00000100:00100000:3.0:1789127225.520735:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276899456 00000100:00100000:3.0:1789127225.520740:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276899456 00000100:00100000:2.0:1789127225.520745:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276900352 00000100:00100000:2.0:1789127225.520750:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276900352 00000100:00100000:3.0:1789127225.520779:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789127225.520783:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276899968 00000100:00100000:2.0:1789127225.520787:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276899968 00000100:00100000:3.0:1789127225.520790:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276899456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.520845:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276899456:12345-0@lo:400:kworker.0 Request processed in 58us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.520852:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789127225.520888:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276899072:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.520913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.520930:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276899584:0@lo:400:kworker.0 00000100:00100000:2.0:1789127225.520999:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127225.521008:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276899328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127225.521093:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127225.521105:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276899840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127225.521434:0:23448:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789127225.521445:0:23448:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1789127225.521678:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276898944 00000100:00100000:0.0:1789127225.521683:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276898944 00000100:00100000:0.0:1789127225.521936:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127225.521949:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276898944:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127225.521978:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876035276899328:12345-0@lo:400:kworker.0 Request processed in 969us (1862us total) trans 0 rc 0/0 00002000:00000024:0.0:1789127225.521999:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127225.522004:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127225.522030:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127225.522038:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276900352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127225.522057:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276898944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.522064:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127225.522082:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276900352:12345-0@lo:400:kworker.0 Request processed in 44us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.522101:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789127225.522123:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127225.522136:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276899968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127225.522166:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876035276899968:12345-0@lo:400:kworker.0 Request processed in 34us (1462us total) trans 0 rc 0/0 00010000:00010000:2.0:1789127225.522344:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789127225.522353:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127225.522358:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127225.522360:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127225.522895:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.522938:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276900096:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.523000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.523040:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789127225.523049:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276899200:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.523082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.523108:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276899712:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.523131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.523158:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276900224:0@lo:400:kworker.0 00000100:00100000:2.0:1789127225.523188:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276899584 00000100:00100000:3.0:1789127225.523189:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.523196:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276899584 00000100:00100000:3.0:1789127225.523225:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276899072 00000100:00100000:3.0:1789127225.523230:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276899072 00000100:00100000:2.0:1789127225.523247:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276899200 00000100:00100000:2.0:1789127225.523252:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276899200 00000100:00100000:3.0:1789127225.523267:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789127225.523273:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276899712 00000100:00100000:2.0:1789127225.523278:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276899712 00000100:00100000:3.0:1789127225.523279:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276899072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127225.523295:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127225.523303:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276899584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127225.523318:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127225.523336:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276900096 00000100:00100000:0.0:1789127225.523339:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276900096 00000100:00100000:2.0:1789127225.523351:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276899584:12345-0@lo:400:kworker.0 Request processed in 48us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.523356:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276900224 00000100:00100000:2.0:1789127225.523358:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127225.523358:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276900224 00000100:00100000:2.0:1789127225.523368:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127225.523371:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127225.523373:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276899200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127225.523376:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276900096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127225.523401:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276899200:12345-0@lo:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.523401:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276900096:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.523408:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127225.523408:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127225.523419:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127225.523419:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789127225.523425:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99421f5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276899712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127225.523425:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276900224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127225.523450:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99421f5df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276899712:12345-0@lo:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.523450:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876035276900224:12345-0@lo:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.523456:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127225.523456:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789127225.523952:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127225.523963:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127225.523966:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127225.525288:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276899072:12345-0@lo:400:kworker.0 Request processed in 2006us (4366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.525301:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789127225.525383:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276899200:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.525396:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276899712:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.525407:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1876035276900224:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.525418:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276899072:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.525430:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276899584:0@lo:400:kworker.0 00010000:00080000:3.0:1789127225.525444:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104af8f00 x1876035276900096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127225.525457:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276900096:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.525574:0:3640:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789127225.525594:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276898688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127225.525626:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276898944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127225.525639:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276899456:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.525665:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1876035276899968:0@lo:400:kworker.0 00000100:00100000:3.0:1789127225.525689:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876035276899328:0@lo:400:kworker.0 00010000:00080000:3.0:1789127225.525701:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104afa580 x1876035276900352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127225.525711:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276900352:0@lo:400:kworker.0 00000100:00100000:1.0:1789127225.525817:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276899840:12345-0@lo:400:kworker.0 Request processed in 4713us (5620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127225.525829:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789127225.526123:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276899840:0@lo:400:kworker.0 00010000:00010000:3.0:1789127226.543021:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127226.543557:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276900480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127226.543687:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127226.544727:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276900480 00000100:00100000:0.0:1789127226.544756:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276900480 00000100:00100000:0.0:1789127226.545033:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127226.545302:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276900480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127226.545347:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789127226.545455:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276900480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 412us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127226.545465:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127226.546976:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276900480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127227.563064:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276900608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127227.563164:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127227.563357:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276900608 00000100:00100000:0.0:1789127227.563367:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276900608 00000100:00100000:0.0:1789127227.563453:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127227.563466:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276900608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127227.563496:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789127227.563559:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa82940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276900608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127227.563567:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127227.563625:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276900608:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789127227.563628:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789127227.564809:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127228.590981:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127228.592729:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127228.592760:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276900736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127228.592850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127228.592905:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276900864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127228.592931:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127228.592994:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276900736 00000100:00100000:2.0:1789127228.593003:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276900736 00000100:00100000:2.0:1789127228.593050:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276900864 00000100:00100000:2.0:1789127228.593054:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276900864 00000100:00100000:2.0:1789127228.593072:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789127228.593083:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276900736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127228.593127:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127228.593179:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276900736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127228.593188:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789127228.593210:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127228.593216:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276900864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127228.593234:0:23453:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789127228.593268:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276900864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127228.593274:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127228.593323:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276900864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127228.593354:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276900736:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1789127228.626079:0:26484:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef3087dd0 20000000:00000080:3.0:1789127228.626102:0:26484:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99423cbe8c00 uarg=0000000000000000 20000000:01000000:3.0:1789127228.626171:0:26484:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127228.626179:0:26484:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127228.626185:0:26484:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789127228.627348:0:26485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:3.0:1789127228.627577:0:26484:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789127228.634872:0:26484:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789127228.635214:0:26484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635237:0:26484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec5b4 expref: 23 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635247:0:26484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec5c2 expref: 23 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635254:0:26484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec601 expref: 23 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635262:0:26484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666ec77b expref: 23 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635289:0:26484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c966 expref: 12 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635297:0:26484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9d6 expref: 12 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635306:0:26484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635363:0:26484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9d6 expref: 12 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635381:0:26484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9d6 expref: 12 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127228.635399:0:26484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276900992:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789127228.635625:0:26484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c966 expref: 12 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635634:0:26484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c966 expref: 12 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127228.635643:0:26484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901120:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789127228.635710:0:26484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec77b expref: 23 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635718:0:26484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec77b expref: 23 pid: 23441 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127228.635741:0:26484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901248:0@lo:104: 00000100:00100000:0.0:1789127228.635794:0:26484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127228.635840:0:26484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec601 expref: 23 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635850:0:26484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec601 expref: 23 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127228.635857:0:26484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901376:0@lo:104: 00000100:00100000:0.0:1789127228.635876:0:26484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127228.635902:0:26484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec5c2 expref: 23 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635909:0:26484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec5c2 expref: 23 pid: 23442 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127228.635916:0:26484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901504:0@lo:104: 00000100:00100000:0.0:1789127228.635935:0:26484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127228.635962:0:26484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa840b4da666ec5b4 expref: 23 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.635981:0:26484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa840b4da666ec5b4 expref: 23 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127228.635989:0:26484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901632:0@lo:104: 00000100:00100000:0.0:1789127228.636010:0:26484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127228.636021:0:26484:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127228.636226:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276901248 00000100:00100000:2.0:1789127228.636236:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276901248 00000100:00100000:2.0:1789127228.636289:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276901376 00000100:00100000:2.0:1789127228.636292:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276901376 00000100:00100000:2.0:1789127228.636303:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276901504 00000100:00100000:2.0:1789127228.636305:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276901504 00000100:00100000:2.0:1789127228.636314:0:23430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276901632 00000100:00100000:2.0:1789127228.636316:0:23430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276901632 00000100:00100000:2.0:1789127228.636331:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127228.636341:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+6:26484:x1876035276901248:12345-0@lo:104: 00010000:00010000:2.0:1789127228.636357:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636437:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127228.636444:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+6:26484:x1876035276901248:12345-0@lo:104: Request processed in 104us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127228.636451:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127228.636472:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127228.636479:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+5:26484:x1876035276901376:12345-0@lo:104: 00010000:00010000:2.0:1789127228.636487:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636532:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789127228.636536:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+5:26484:x1876035276901376:12345-0@lo:104: Request processed in 58us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127228.636543:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127228.636555:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127228.636561:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+4:26484:x1876035276901504:12345-0@lo:104: 00010000:00010000:2.0:1789127228.636569:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636611:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789127228.636616:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+4:26484:x1876035276901504:12345-0@lo:104: Request processed in 56us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127228.636622:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127228.636635:0:23430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127228.636641:0:23430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:26484:x1876035276901632:12345-0@lo:104: 00010000:00010000:2.0:1789127228.636669:0:23430:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636697:0:23430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789127228.636702:0:23430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+3:26484:x1876035276901632:12345-0@lo:104: Request processed in 62us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127228.636708:0:23430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789127228.636728:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789127228.636735:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636743:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca200 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789127228.636748:0:25263:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636757:0:25263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127228.636766:0:25263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127228.636772:0:25263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127228.636818:0:25263:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636824:0:25263:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127228.636845:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636851:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364ca200/0xa840b4da666ec77b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec782 expref: -99 pid: 25776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636866:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789127228.636869:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636909:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca400 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789127228.636912:0:25263:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.636919:0:25263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127228.636925:0:25263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127228.636931:0:25263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127228.637480:0:25263:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637541:0:25263:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127228.637572:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637593:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff9942364ca400/0xa840b4da666ec601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec608 expref: -99 pid: 24953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637606:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127228.637610:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637616:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3c00 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789127228.637619:0:25263:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637627:0:25263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127228.637634:0:25263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127228.637640:0:25263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127228.637684:0:25263:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637691:0:25263:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127228.637698:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637704:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3c00/0xa840b4da666ec5c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec5c9 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637713:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127228.637722:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637729:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3600 already unused, calling callback (ffffffffc132ec20) 10000000:00010000:2.0:1789127228.637731:0:25263:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637738:0:25263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127228.637744:0:25263:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127228.637748:0:25263:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127228.637763:0:25263:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637769:0:25263:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127228.637776:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637781:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666ec5b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa840b4da666ec5bb expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.637796:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127228.637798:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127228.637799:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127228.637809:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127228.637816:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127228.637844:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276901760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127228.637899:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127228.638073:0:26484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901248:0@lo:104: 00000100:00100000:0.0:1789127228.638101:0:26484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901376:0@lo:104: 00000100:00100000:0.0:1789127228.638110:0:26484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901504:0@lo:104: 00000100:00100000:0.0:1789127228.638118:0:26484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901632:0@lo:104: 00000100:00100000:3.0:1789127228.638330:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276901888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127228.638364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127228.638425:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276901760 00000100:00100000:0.0:1789127228.638431:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276901760 00010000:00010000:0.0:1789127228.638463:0:23434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec77b expref: 24 pid: 23441 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127228.638574:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276901888 00000100:00100000:0.0:1789127228.638580:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276901888 00010000:00010000:0.0:1789127228.638593:0:23434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec601 expref: 25 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127228.638639:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127228.638645:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276902144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127228.638689:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127228.638768:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9941040192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3640:1876035276902016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127228.639093:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276902144 00000100:00100000:3.0:1789127228.639098:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276902144 00010000:00010000:3.0:1789127228.639115:0:23432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec5b4 expref: 26 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127228.639132:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127228.639147:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+26:3642:x1876035276901760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127228.639162:0:23432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127228.639168:0:23432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec77b expref: 26 pid: 23441 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.639179:0:23432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec77b expref: 26 pid: 23441 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.639198:0:23432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb200/0xa840b4da666ec782 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec77b expref: 26 pid: 23441 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.639214:0:23432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127228.639245:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+25:3642:x1876035276901760:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127228.639253:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127228.639270:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127228.639275:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3639:x1876035276901888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127228.639281:0:23432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127228.639285:0:23432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec601 expref: 24 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.639294:0:23432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec601 expref: 24 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.639303:0:23432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148f000/0xa840b4da666ec608 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec601 expref: 24 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.639312:0:23432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127228.639328:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:3639:x1876035276901888:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127228.639339:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127228.639349:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127228.639354:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:3642:x1876035276902144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127228.639360:0:23432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127228.639365:0:23432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec5b4 expref: 22 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.639373:0:23432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec5b4 expref: 22 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.639383:0:23432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9942364cb600/0xa840b4da666ec5bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec5b4 expref: 22 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.639391:0:23432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127228.639407:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:3642:x1876035276902144:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127228.639412:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127228.639784:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276901888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127228.640153:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127228.640337:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276902016 00000100:00100000:2.0:1789127228.640343:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276902016 00010000:00010000:2.0:1789127228.640366:0:23433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec5c2 expref: 21 pid: 23442 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127228.640430:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127228.640439:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:3640:x1876035276902016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127228.640448:0:23432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127228.640453:0:23432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa840b4da666ec5c2 expref: 21 pid: 23442 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.640462:0:23432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa840b4da666ec5c2 expref: 21 pid: 23442 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.640488:0:23432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99420148e200/0xa840b4da666ec5c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa840b4da666ec5c2 expref: 21 pid: 23442 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127228.640776:0:23432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127228.642415:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:3640:x1876035276902016:12345-0@lo:103:ldlm_bl.0 Request processed in 1968us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127228.642428:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127228.642801:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9941040192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3640:1876035276902016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127228.642907:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104018b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276902144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127228.642918:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410401bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3642:1876035276901760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127228.643333:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127228.643412:0:26484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276900992:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789127228.643423:0:26484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26484:1876035276901120:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789127228.643458:0:26484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127228.643794:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127228.643836:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258968448 00000100:00100000:0.0:1789127228.643844:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258968448 00010000:00010000:0.0:1789127228.643885:0:23434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9d6 expref: 13 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127228.643915:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:0.0:1789127228.643925:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:2394:x1876035258968448:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127228.644230:0:23434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127228.644238:0:23434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9d6 expref: 13 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.644251:0:23434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9d6 expref: 13 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.644273:0:23434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e2400/0xa840b4da666ec92d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c9d6 expref: 13 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127228.644310:0:23434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127228.644372:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:2394:x1876035258968448:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 448us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127228.644380:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 13 00000100:00100000:1.0:1789127228.650298:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258968576 00000100:00100000:1.0:1789127228.650321:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258968576 00010000:00010000:1.0:1789127228.650390:0:24204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c966 expref: 12 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127228.652750:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:1.0:1789127228.652778:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:2394:x1876035258968576:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127228.652805:0:24204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127228.652817:0:24204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c966 expref: 12 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.652835:0:24204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c966 expref: 12 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.652859:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99422f9e3400/0xa840b4da666ec8ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c966 expref: 12 pid: 23439 timeout: 753 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.652880:0:24204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.652890:0:24204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.652932:0:24204:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.652939:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.653022:0:24204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.653032:0:24204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.653039:0:24204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe0e00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127228.653044:0:24204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.653054:0:24204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.653422:0:26484:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127228.653432:0:26484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.655386:0:24204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.655409:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99423cbe0e00/0xa840b4da666ec95e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127228.655434:0:24204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127228.655611:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:2394:x1876035258968576:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 2838us (11809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127228.655625:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00010000:00010000:2.0:1789127229.612021:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127229.718096:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127229.718262:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258968704 00000100:00100000:2.0:1789127229.718275:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258968704 00000100:00100000:2.0:1789127229.718435:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00100000:2.0:1789127229.718448:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+11:18327:x1876035258968704:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127229.718469:0:23442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127229.718496:0:23442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200031c00/0xa840b4da666ec965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca0e expref: -99 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127229.718541:0:23442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200031c00/0xa840b4da666ec965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca0e expref: 12 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127229.718554:0:23442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200031c00/0xa840b4da666ec965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca0e expref: 12 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127229.718573:0:23442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031c00, rc 0) 00000100:00100000:2.0:1789127229.718696:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:18327:x1876035258968704:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 251us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127229.718704:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 145 00000100:00100000:0.0:1789127229.731519:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127229.731938:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258968832 00000100:00100000:2.0:1789127229.731953:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258968832 00000100:00100000:2.0:1789127229.732041:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 146 00000100:00100000:2.0:1789127229.732053:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:18327:x1876035258968832:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127229.732469:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208441c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:18327:x1876035258968832:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 415us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127229.732479:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 146 00000100:00100000:3.0:1789127229.743336:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127229.743459:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258968960 00000100:00100000:2.0:1789127229.743474:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258968960 00000100:00100000:2.0:1789127229.743600:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:2.0:1789127229.743612:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:18327:x1876035258968960:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127229.743843:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:18327:x1876035258968960:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 233us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127229.743853:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 147 00000100:00100000:1.0:1789127229.754244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127229.754914:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258969088 00000100:00100000:0.0:1789127229.754929:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258969088 00000100:00100000:0.0:1789127229.755028:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:0.0:1789127229.755043:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+12:18327:x1876035258969088:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127229.755064:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127229.755087:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99423cbe0c00/0xa840b4da666ec96c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca15 expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127229.755126:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99423cbe0c00/0xa840b4da666ec96c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca15 expref: 13 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127229.755140:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99423cbe0c00/0xa840b4da666ec96c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca15 expref: 13 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127229.755153:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe0c00, rc 0) 00000100:00100000:0.0:1789127229.755232:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18327:x1876035258969088:12345-192.168.203.23@tcp:101:ll_cfg_requeue.0 Request processed in 193us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127229.755241:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 148 00000100:00100000:1.0:1789127229.760340:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127229.760746:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258969216 00000100:00100000:2.0:1789127229.760759:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258969216 00000100:00100000:2.0:1789127229.760831:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 149 00000100:00100000:2.0:1789127229.760843:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18327:x1876035258969216:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127229.761104:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18327:x1876035258969216:12345-192.168.203.23@tcp:501:ll_cfg_requeue.0 Request processed in 262us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127229.761115:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 149 00000100:00100000:3.0:1789127229.770495:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127229.771953:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258969344 00000100:00100000:0.0:1789127229.771980:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258969344 00000100:00100000:0.0:1789127229.772079:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 150 00000100:00100000:0.0:1789127229.772100:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18327:x1876035258969344:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127229.772320:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208442850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:18327:x1876035258969344:12345-192.168.203.23@tcp:503:ll_cfg_requeue.0 Request processed in 222us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127229.772330:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 150 00000100:00100000:2.0:1789127230.161302:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.161737:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258969472 00000100:00100000:0.0:1789127230.161750:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258969472 00000100:00100000:0.0:1789127230.161909:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1789127230.161922:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:18952:x1876035258969472:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127230.161950:0:23448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127230.161988:0:23448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ec973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca1c expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162074:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162091:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162108:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162123:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162130:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162136:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162245:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1200/0xa840b4da666ec988 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162261:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1200/0xa840b4da666ec988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162269:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1200/0xa840b4da666ec988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127230.162302:0:23448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127230.162306:0:23448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127230.162348:0:23448:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1200/0xa840b4da666ec988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162359:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162366:0:23448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162372:0:23448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162378:0:23448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127230.162382:0:23448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162390:0:23448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162403:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99420b04a000) 00010000:00010000:0.0:1789127230.162407:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127230.162412:0:23448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162428:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec97a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162444:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162449:0:23448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162455:0:23448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162460:0:23448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe0800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127230.162463:0:23448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162470:0:23448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162477:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff994103ea6600) 00010000:00010000:0.0:1789127230.162480:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127230.162483:0:23448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162489:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ec981 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162525:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ec973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca1c expref: 8 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162549:0:23448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1200/0xa840b4da666ec988 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca1c expref: 7 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.162558:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994103ea6300) 00010000:00010000:0.0:1789127230.162561:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127230.162563:0:23448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe1200, rc 0) 00000100:00100000:0.0:1789127230.163235:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:18952:x1876035258969472:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1310us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.163246:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00080000:1.0:1789127230.167513:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127230.179024:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127230.179201:0:23458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258969600 00000100:00100000:1.0:1789127230.179215:0:23458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258969600 00000100:00100000:1.0:1789127230.179290:0:23458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:1.0:1789127230.179302:0:23458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:18952:x1876035258969600:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789127230.179411:0:23458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:18952:x1876035258969600:12345-192.168.203.23@tcp:900:lhsmtool_posix.0 Request processed in 111us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.179419:0:23458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:2.0:1789127230.184007:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.184270:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258969856 00000100:00100000:3.0:1789127230.184284:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258969856 00000100:00100000:3.0:1789127230.184364:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:3.0:1789127230.184375:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:18952:x1876035258969856:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127230.184403:0:23447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127230.184432:0:23447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ec98f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca23 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.184525:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.184543:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.184576:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.184596:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.184603:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.184610:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.184810:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666ec9a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.184819:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666ec9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.184827:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666ec9a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127230.184838:0:23447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789127230.185368:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185378:0:23447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185386:0:23447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185394:0:23447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127230.185407:0:23447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185417:0:23447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185433:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff994103ea6300) 00010000:00010000:3.0:1789127230.185437:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127230.185443:0:23447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185451:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec996 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185466:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185473:0:23447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185479:0:23447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185485:0:23447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127230.185488:0:23447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185495:0:23447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185503:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff994238d22200) 00010000:00010000:3.0:1789127230.185506:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127230.185516:0:23447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.185522:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec99d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.187205:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ec98f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca23 expref: 10 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.187235:0:23447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166a00/0xa840b4da666ec9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca23 expref: 9 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.187244:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994238d22d00) 00010000:00010000:3.0:1789127230.187247:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127230.187251:0:23447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166a00, rc 0) 00000100:00100000:3.0:1789127230.187389:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+9:18952:x1876035258969856:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 3015us (3404us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789127230.187400:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 24 00000100:00100000:2.0:1789127230.203427:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127230.203547:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258969984 00000100:00100000:1.0:1789127230.203559:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258969984 00000100:00100000:1.0:1789127230.203687:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:1.0:1789127230.203700:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422051da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+9:18952:x1876035258969984:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789127230.204125:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422051da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+9:18952:x1876035258969984:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 427us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.204134:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 25 00000100:00100000:0.0:1789127230.213624:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127230.215852:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258970112 00000100:00100000:2.0:1789127230.215871:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258970112 00000100:00100000:2.0:1789127230.215999:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:2.0:1789127230.216015:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:18952:x1876035258970112:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789127230.220034:0:26359:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3960us 00000100:00080000:1.0:1789127230.220420:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127230.238672:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:18952:x1876035258970112:12345-192.168.203.23@tcp:59:lhsmtool_posix.0 Request processed in 22621us (25022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.238692:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:2.0:1789127230.244986:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.245262:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258970240 00000100:00100000:3.0:1789127230.245276:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258970240 00000100:00100000:3.0:1789127230.245353:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:3.0:1789127230.245364:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+9:18958:x1876035258970240:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789127230.245393:0:23447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127230.245426:0:23447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ec9b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca2a expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245531:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245550:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245564:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245581:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245588:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245594:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245666:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245673:0:23447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245680:0:23447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245686:0:23447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127230.245691:0:23447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245709:0:23447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245724:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99420b04a000) 00010000:00010000:3.0:1789127230.245727:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127230.245732:0:23447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245738:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166600/0xa840b4da666ec9b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245752:0:23447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245758:0:23447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245764:0:23447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245769:0:23447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127230.245772:0:23447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.245778:0:23447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.246298:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff994238d22200) 00010000:00010000:3.0:1789127230.246301:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127230.246305:0:23447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.246322:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.246368:0:23447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ec9b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca2a expref: 10 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.246379:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99420b04a000) 00010000:00010000:3.0:1789127230.246382:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127230.246386:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ec9b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca2a expref: 10 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.246395:0:23447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167a00, rc 0) 00000100:00100000:3.0:1789127230.246537:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+9:18958:x1876035258970240:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 1174us (1566us total) trans 0 rc 301/301 00000100:00100000:3.0:1789127230.246546:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:2.0:1789127230.251704:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.251800:0:23456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258970368 00000100:00100000:0.0:1789127230.251820:0:23456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258970368 00000100:00100000:0.0:1789127230.251893:0:23456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1789127230.251903:0:23456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ce39c917-de43-41d2-aa7b-028f64ef55d1+9:18958:x1876035258970368:12345-192.168.203.23@tcp:700:lfs.0 00000100:00100000:0.0:1789127230.252026:0:23456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ce39c917-de43-41d2-aa7b-028f64ef55d1+9:18958:x1876035258970368:12345-192.168.203.23@tcp:700:lfs.0 Request processed in 123us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.252035:0:23456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:2.0:1789127230.256635:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.256775:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258970624 00000100:00100000:0.0:1789127230.256797:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258970624 00000100:00100000:0.0:1789127230.256871:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00100000:0.0:1789127230.256884:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e854b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+9:18958:x1876035258970624:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:0.0:1789127230.256963:0:23448:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127230.257022:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ec918 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1c997 expref: 9 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.257043:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99420b04a000) 00010000:00010000:0.0:1789127230.257050:0:23448:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127230.257126:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.257142:0:23448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca07 expref: 5 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.257153:0:23448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.257195:0:23448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca07 expref: 5 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.257211:0:23448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca07 expref: 5 pid: 24979 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127230.257228:0:23448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23448:1876035276902272:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789127230.257727:0:23448:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127230.260447:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127230.260553:0:23448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410501b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23448:1876035276902272:192.168.203.23@tcp:104: 00010000:00010000:2.0:1789127230.260588:0:23448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127230.261068:0:23432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258970752 00000100:00100000:3.0:1789127230.261076:0:23432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258970752 00010000:00010000:3.0:1789127230.261170:0:23432:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca07 expref: 6 pid: 24979 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127230.261205:0:23432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:3.0:1789127230.261216:0:23432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:2394:x1876035258970752:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127230.261234:0:23432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127230.261242:0:23432:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca07 expref: 6 pid: 24979 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.261275:0:23432:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca07 expref: 6 pid: 24979 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.261302:0:23432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec957 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca07 expref: 6 pid: 24979 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.261319:0:23432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99420b04a000) 00010000:00010000:3.0:1789127230.261325:0:23432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.261335:0:23432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.261345:0:23432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.261382:0:23432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127230.261451:0:23432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941050183c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2394:x1876035258970752:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 236us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.261460:0:23432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00010000:00010000:2.0:1789127230.261742:0:23448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.261751:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.261792:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.261804:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.261813:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265611:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265677:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265692:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127230.265714:0:23448:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001bc8b4b0 reply state 000000004e839562 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265726:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265736:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:2.0:1789127230.265740:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789127230.265745:0:23448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789127230.265753:0:23448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789127230.265763:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265770:0:23448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265778:0:23448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265784:0:23448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127230.265790:0:23448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265798:0:23448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265821:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99420b04a000) 00010000:00010000:2.0:1789127230.265823:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127230.265828:0:23448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265835:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ec9c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127230.265857:0:23448:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001bc8b4b0 reply state 000000004e839562 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265866:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.265873:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff994103eaa600) 00010000:00010000:2.0:1789127230.265875:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789127230.266032:0:23448:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789127230.266190:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e854b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+10:18958:x1876035258970624:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 9303us (9567us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789127230.266200:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 28 00000100:00080000:1.0:1789127230.267679:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127230.285492:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.285541:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.285591:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127230.285593:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258971008 00000100:00100000:2.0:1789127230.285607:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258971008 00000100:00100000:0.0:1789127230.285643:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.285714:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127230.285725:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258971264 00000100:00100000:2.0:1789127230.285729:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258971264 00000100:00100000:2.0:1789127230.285750:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258970880 00000100:00100000:2.0:1789127230.285754:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258970880 00000100:00100000:3.0:1789127230.285766:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258971392 00000100:00100000:3.0:1789127230.285773:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258971392 00000100:00100000:2.0:1789127230.285779:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00100000:2.0:1789127230.285805:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2391:x1876035258971008:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127230.285874:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:3.0:1789127230.285885:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2391:x1876035258971264:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127230.285915:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105018780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2391:x1876035258971008:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 114us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.285926:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994105019e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2391:x1876035258971264:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.285935:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 15 00000100:00100000:1.0:1789127230.286040:0:25262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:1.0:1789127230.286051:0:25262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2391:x1876035258970880:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127230.286084:0:25262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2391:x1876035258970880:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 37us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.286091:0:25262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:2.0:1789127230.286135:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 14 00000100:00080000:0.0:1789127230.286790:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127230.286811:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127230.287196:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:3.0:1789127230.287212:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2391:x1876035258971392:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127230.287283:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258971136 00000100:00100000:3.0:1789127230.287286:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2391:x1876035258971392:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 77us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.287290:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258971136 00000100:00100000:3.0:1789127230.287296:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:1.0:1789127230.287351:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:1.0:1789127230.287360:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2391:x1876035258971136:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:1.0:1789127230.287392:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2391:x1876035258971136:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 35us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.287398:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00080000:1.0:1789127230.287416:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127230.357228:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.357314:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258971520 00000100:00100000:3.0:1789127230.357327:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258971520 00000100:00100000:3.0:1789127230.357416:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1789127230.357428:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+10:18966:x1876035258971520:12345-192.168.203.23@tcp:101:lctl.0 00010000:00010000:3.0:1789127230.357460:0:23447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127230.357490:0:23447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ec9dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca31 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.357578:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.357595:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.357608:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127230.357829:0:23447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127230.357834:0:23447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127230.357884:0:23447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.357913:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ec9dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca31 expref: 12 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.357965:0:23447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166400/0xa840b4da666ec9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca31 expref: 11 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.357975:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994238d22200) 00010000:00010000:3.0:1789127230.357978:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127230.357982:0:23447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166400, rc 0) 00000100:00100000:3.0:1789127230.358302:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+11:18966:x1876035258971520:12345-192.168.203.23@tcp:101:lctl.0 Request processed in 875us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.358311:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:0.0:1789127230.388216:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127230.388736:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258971648 00000100:00100000:2.0:1789127230.388752:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258971648 00000100:00100000:2.0:1789127230.388976:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:2.0:1789127230.388990:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:18967:x1876035258971648:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:2.0:1789127230.389087:0:23448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127230.389117:0:23448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200030400/0xa840b4da666ec9ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca38 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.389201:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec9f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.389218:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.389233:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127230.389288:0:23448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789127230.389292:0:23448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127230.389318:0:23448:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.389346:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030400/0xa840b4da666ec9ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca38 expref: 7 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.389370:0:23448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994200031800/0xa840b4da666ec9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca38 expref: 6 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.389403:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994238d22200) 00010000:00010000:2.0:1789127230.389407:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127230.389412:0:23448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200031800, rc 0) 00000100:00100000:2.0:1789127230.389513:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:18967:x1876035258971648:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 526us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127230.389522:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:0.0:1789127230.395371:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127230.395467:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258971776 00000100:00100000:1.0:1789127230.395481:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258971776 00000100:00100000:1.0:1789127230.395971:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:1.0:1789127230.395987:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:18967:x1876035258971776:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789127230.396024:0:26359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127230.396053:0:26359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec9f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca3f expref: -99 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396156:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396173:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396187:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396199:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396206:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396213:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396331:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eca0d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396341:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eca0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396348:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eca0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127230.396397:0:26359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789127230.396401:0:26359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127230.396431:0:26359:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eca0d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396444:0:26359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396451:0:26359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396458:0:26359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396466:0:26359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127230.396470:0:26359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396480:0:26359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396494:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994238d22200) 00010000:00010000:1.0:1789127230.396503:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127230.396511:0:26359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396517:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666ec9ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396532:0:26359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396538:0:26359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396545:0:26359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396551:0:26359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127230.396554:0:26359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396560:0:26359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396568:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff994103eaa600) 00010000:00010000:1.0:1789127230.396571:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127230.396574:0:26359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396580:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396613:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2400/0xa840b4da666ec9f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca3f expref: 8 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396642:0:26359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eca0d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca3f expref: 7 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.396681:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:1.0:1789127230.396684:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127230.396687:0:26359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3c00, rc 0) 00000100:00100000:1.0:1789127230.396780:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20e4c89f-9d0f-4fa6-a881-4560a0c09634+7:18967:x1876035258971776:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 797us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.401587:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.401767:0:23458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258971904 00000100:00100000:3.0:1789127230.401782:0:23458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258971904 00000100:00100000:3.0:1789127230.401853:0:23458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1789127230.401865:0:23458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:18967:x1876035258971904:12345-192.168.203.23@tcp:900:lfs.0 00000100:00100000:3.0:1789127230.401982:0:23458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:18967:x1876035258971904:12345-192.168.203.23@tcp:900:lfs.0 Request processed in 119us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.401990:0:23458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:1.0:1789127230.403574:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:0.0:1789127230.406776:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127230.406872:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258972160 00000100:00100000:2.0:1789127230.406897:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258972160 00000100:00100000:0.0:1789127230.407776:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:0.0:1789127230.407791:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+7:18967:x1876035258972160:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789127230.407820:0:23449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127230.407849:0:23449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1400/0xa840b4da666eca14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca46 expref: -99 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127230.408307:0:23449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789127230.408452:0:23449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1400/0xa840b4da666eca14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca46 expref: 9 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.408470:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994238d22200) 00010000:00010000:0.0:1789127230.408474:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127230.408480:0:23449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1400/0xa840b4da666eca14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca46 expref: 9 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.408498:0:23449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe1400, rc 0) 00000100:00100000:0.0:1789127230.408639:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+8:18967:x1876035258972160:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 850us (1878us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789127230.408696:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 32 00000100:00100000:2.0:1789127230.420725:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.420827:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258972416 00000100:00100000:3.0:1789127230.420840:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258972416 00000100:00100000:3.0:1789127230.420909:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:3.0:1789127230.420920:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e8570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+8:18967:x1876035258972416:12345-192.168.203.23@tcp:36:lfs.0 00010000:00010000:3.0:1789127230.421001:0:23447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127230.421043:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3c00/0xa840b4da666eca0d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca3f expref: 8 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.421066:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:3.0:1789127230.421088:0:23447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127230.421117:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.421133:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.421146:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127230.421395:0:23447:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c65e8692 reply state 0000000055e52e17 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.421410:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.421417:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:3.0:1789127230.421419:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789127230.421423:0:23447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789127230.421432:0:23447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789127230.421532:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e8570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+9:18967:x1876035258972416:12345-192.168.203.23@tcp:36:lfs.0 Request processed in 613us (822us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1789127230.421541:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 33 00000100:00100000:1.0:1789127230.428522:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.428620:0:23450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258972672 00000100:00100000:3.0:1789127230.428635:0:23450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258972672 00000100:00100000:3.0:1789127230.428729:0:23450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:3.0:1789127230.428741:0:23450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+9:18967:x1876035258972672:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789127230.429221:0:23450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+10:18967:x1876035258972672:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 482us (715us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789127230.429231:0:23450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:0.0:1789127230.440782:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127230.441041:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258972928 00000100:00100000:1.0:1789127230.441054:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258972928 00000100:00100000:1.0:1789127230.441141:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:1.0:1789127230.441153:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20e4c89f-9d0f-4fa6-a881-4560a0c09634+10:18967:x1876035258972928:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:1.0:1789127230.441186:0:26359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127230.441213:0:26359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca4d expref: -99 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441303:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441319:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441332:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441360:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441369:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441376:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127230.441512:0:26359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789127230.441612:0:26359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441621:0:26359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441628:0:26359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441634:0:26359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127230.441639:0:26359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441702:0:26359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441717:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994238d22200) 00010000:00010000:1.0:1789127230.441720:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127230.441726:0:26359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441743:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3000/0xa840b4da666eca30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441759:0:26359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441766:0:26359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441772:0:26359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441777:0:26359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127230.441779:0:26359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441785:0:26359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441794:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff994103eaa600) 00010000:00010000:1.0:1789127230.441796:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127230.441799:0:26359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441805:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2e00/0xa840b4da666eca37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441848:0:26359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca29 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca4d expref: 12 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.441875:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994238d22200) 00010000:00010000:1.0:1789127230.442415:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127230.442422:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3600/0xa840b4da666eca29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca4d expref: 12 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.442435:0:26359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3600, rc 0) 00000100:00100000:0.0:1789127230.444322:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:20e4c89f-9d0f-4fa6-a881-4560a0c09634+11:18967:x1876035258972928:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 3156us (3541us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1789127230.444350:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 34 00000100:00100000:2.0:1789127230.458195:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.460240:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258973056 00000100:00100000:0.0:1789127230.460259:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258973056 00000100:00100000:0.0:1789127230.460341:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:0.0:1789127230.460353:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423e855e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+11:18967:x1876035258973056:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789127230.460384:0:23449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127230.460412:0:23449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1400/0xa840b4da666eca45 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca54 expref: -99 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.460530:0:23449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.460548:0:23449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.460562:0:23449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127230.460593:0:23449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127230.460597:0:23449:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127230.460621:0:23449:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.460695:0:23449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1400/0xa840b4da666eca45 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca54 expref: 13 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.460717:0:23449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca54 expref: 12 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.460747:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:0.0:1789127230.460750:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127230.460755:0:23449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe1000, rc 0) 00000100:00100000:0.0:1789127230.460836:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423e855e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+12:18967:x1876035258973056:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 484us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.460843:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 35 00000100:00100000:1.0:1789127230.464496:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.464594:0:23451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258973184 00000100:00100000:0.0:1789127230.464606:0:23451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258973184 00000100:00100000:0.0:1789127230.464711:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:0.0:1789127230.464723:0:23451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+12:18967:x1876035258973184:12345-192.168.203.23@tcp:37:lfs.0 00000100:00100000:0.0:1789127230.476576:0:23451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+12:18967:x1876035258973184:12345-192.168.203.23@tcp:37:lfs.0 Request processed in 11837us (12077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.476595:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 3 00000100:00100000:2.0:1789127230.495768:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.495867:0:23450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258973440 00000100:00100000:3.0:1789127230.495888:0:23450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258973440 00000100:00100000:3.0:1789127230.495959:0:23450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 4 00000100:00100000:3.0:1789127230.495972:0:23450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942385af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+12:18967:x1876035258973440:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789127230.496282:0:23450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942385af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:20e4c89f-9d0f-4fa6-a881-4560a0c09634+13:18967:x1876035258973440:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 311us (526us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1789127230.496291:0:23450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 4 10000000:01000000:2.0:1789127230.509294:0:23444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127230.509305:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99423cb1b800 from 19 10000000:01000000:2.0:1789127230.509312:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127230.509382:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666eca53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.509396:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666eca53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.509410:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666eca53 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127230.509444:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127230.509556:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127230.509619:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942313e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127230.509899:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276902400 00000100:00100000:1.0:1789127230.509909:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276902400 00000100:00100000:1.0:1789127230.509979:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789127230.509992:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+20:23444:x1876035276902400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127230.510012:0:23442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127230.510032:0:23442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eca5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eca53 expref: -99 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.510064:0:23442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eca5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eca53 expref: 21 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.510089:0:23442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e2e00/0xa840b4da666eca5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eca53 expref: 21 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.510100:0:23442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e2e00, rc 0) 00000100:00100000:1.0:1789127230.510167:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:23444:x1876035276902400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.510177:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789127230.510397:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127230.510440:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666eca53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca5a expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.510451:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666eca53 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eca5a expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127230.510534:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127230.510562:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127230.510594:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942313e9000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127230.510708:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276902528 00000100:00100000:0.0:1789127230.510713:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276902528 00000100:00100000:0.0:1789127230.510751:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789127230.510759:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:23444:x1876035276902528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127230.510920:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208441850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:23444:x1876035276902528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.510928:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789127230.511063:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127230.511111:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127230.511158:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127230.511186:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942313e9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789127230.511315:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276902656 00000100:00100000:3.0:1789127230.511321:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276902656 00000100:00100000:3.0:1789127230.511349:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789127230.511357:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994208440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:23444:x1876035276902656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127230.511464:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994208440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:23444:x1876035276902656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.511472:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789127230.511628:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789127230.512583:0:26498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789127230.513089:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789127230.513117:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127230.513129:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666eca53 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca5a expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.513141:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994200031200/0xa840b4da666eca53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca5a expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127230.513152:0:23444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127230.513155:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9942364bc800 from 19 10000000:01000000:3.0:1789127230.513158:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127230.513202:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212166600/0xa840b4da666eca61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.513211:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff994212166600/0xa840b4da666eca61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.513235:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff994212166600/0xa840b4da666eca61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127230.513262:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127230.513335:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.513387:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127230.513556:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276902784 00000100:00100000:2.0:1789127230.513564:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276902784 00000100:00100000:2.0:1789127230.513751:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789127230.513762:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+21:23444:x1876035276902784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127230.513777:0:23441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127230.513794:0:23441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994200030400/0xa840b4da666eca68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eca61 expref: -99 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.513821:0:23441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994200030400/0xa840b4da666eca68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eca61 expref: 22 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.513832:0:23441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994200030400/0xa840b4da666eca68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eca61 expref: 22 pid: 23441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.513850:0:23441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994200030400, rc 0) 00000100:00100000:2.0:1789127230.513913:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:23444:x1876035276902784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127230.513920:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789127230.514090:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127230.514106:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff994212166600/0xa840b4da666eca61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca68 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.514115:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff994212166600/0xa840b4da666eca61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eca68 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127230.514193:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127230.514226:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.524871:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127230.526995:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276902912 00000100:00100000:0.0:1789127230.527014:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276902912 00000100:00100000:0.0:1789127230.527109:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789127230.527122:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:23444:x1876035276902912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127230.527371:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:23444:x1876035276902912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (13144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.527381:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789127230.527740:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276902912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127230.527812:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127230.527873:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.527916:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127230.529025:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276903040 00000100:00100000:0.0:1789127230.529036:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276903040 00000100:00100000:0.0:1789127230.529100:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789127230.529112:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:23444:x1876035276903040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127230.529276:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:23444:x1876035276903040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.529285:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789127230.529576:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789127230.531728:0:26499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789127230.531969:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789127230.532006:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127230.532040:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff994212166600/0xa840b4da666eca61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca68 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.532052:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff994212166600/0xa840b4da666eca61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca68 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127230.532065:0:23444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127230.532069:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99422043b000 from 19 10000000:01000000:1.0:1789127230.532072:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127230.532132:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666eca6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.532141:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666eca6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.532154:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666eca6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127230.532185:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127230.532274:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127230.532331:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942017f9180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127230.532588:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276903168 00000100:00100000:3.0:1789127230.532596:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276903168 00000100:00100000:3.0:1789127230.532691:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789127230.532702:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+22:23444:x1876035276903168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127230.532718:0:23439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127230.532735:0:23439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994212166800/0xa840b4da666eca76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eca6f expref: -99 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.532763:0:23439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994212166800/0xa840b4da666eca76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eca6f expref: 23 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.532775:0:23439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994212166800/0xa840b4da666eca76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eca6f expref: 23 pid: 23439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.532786:0:23439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166800, rc 0) 00000100:00100000:3.0:1789127230.532841:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276903168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.532849:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789127230.532902:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127230.532919:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666eca6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca76 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.532929:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666eca6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eca76 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127230.533013:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127230.533042:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.533058:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127230.533072:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276903296 00000100:00100000:3.0:1789127230.533344:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276903296 00000100:00100000:3.0:1789127230.533378:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789127230.533386:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276903296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127230.538045:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276903296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4644us (4987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.538062:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789127230.541034:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa821c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127230.544984:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127230.545163:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127230.545240:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942313e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127230.548324:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276903424 00000100:00100000:1.0:1789127230.548348:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276903424 00000100:00100000:1.0:1789127230.548474:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789127230.548487:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276903424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127230.552098:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276903424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3588us (6909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.552145:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789127230.552693:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789127230.553863:0:26500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789127230.554240:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789127230.554271:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127230.554286:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666eca6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca76 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.554301:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99422f9e3600/0xa840b4da666eca6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca76 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127230.554313:0:23444:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127230.554317:0:23444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff994103e26000 from 19 10000000:01000000:0.0:1789127230.554320:0:23444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127230.554365:0:23444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.123@tcp lock: ffff99423cbe1400/0xa840b4da666eca7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.554374:0:23444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.123@tcp lock: ffff99423cbe1400/0xa840b4da666eca7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.554385:0:23444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.123@tcp lock: ffff99423cbe1400/0xa840b4da666eca7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127230.554429:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127230.554510:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127230.554572:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127230.554966:0:23442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276903552 00000100:00100000:1.0:1789127230.554975:0:23442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276903552 00000100:00100000:1.0:1789127230.555235:0:23442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789127230.555248:0:23442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+23:23444:x1876035276903552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127230.555266:0:23442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127230.555284:0:23442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99422f9e3e00/0xa840b4da666eca84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa840b4da666eca7d expref: -99 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.555316:0:23442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99422f9e3e00/0xa840b4da666eca84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa840b4da666eca7d expref: 24 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.555329:0:23442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99422f9e3e00/0xa840b4da666eca84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa840b4da666eca7d expref: 24 pid: 23442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.555339:0:23442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3e00, rc 0) 00000100:00100000:1.0:1789127230.555405:0:23442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:23444:x1876035276903552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.555413:0:23442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789127230.555509:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127230.555527:0:23444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.123@tcp lock: ffff99423cbe1400/0xa840b4da666eca7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca84 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.555537:0:23444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.123@tcp lock: ffff99423cbe1400/0xa840b4da666eca7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa840b4da666eca84 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127230.555643:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127230.555692:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127230.557284:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994104334000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127230.558201:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276903680 00000100:00100000:2.0:1789127230.558215:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276903680 00000100:00100000:0.0:1789127230.558336:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789127230.558347:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:23444:x1876035276903680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127230.558569:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:23444:x1876035276903680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (2876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.558577:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789127230.558856:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420a88d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127230.558924:0:23444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127230.559003:0:23444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127230.559043:0:23444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942313e9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127230.559219:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276903808 00000100:00100000:0.0:1789127230.559224:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276903808 00000100:00100000:0.0:1789127230.559247:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789127230.559254:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:23444:x1876035276903808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127230.559387:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:23444:x1876035276903808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.559404:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789127230.559859:0:23444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:23444:1876035276903808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789127230.561351:0:26501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789127230.561830:0:23444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789127230.561862:0:23444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127230.561876:0:23444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.123@tcp lock: ffff99423cbe1400/0xa840b4da666eca7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca84 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.561890:0:23444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.123@tcp lock: ffff99423cbe1400/0xa840b4da666eca7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa840b4da666eca84 expref: -99 pid: 23444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127230.577089:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127230.577283:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258973568 00000100:00100000:2.0:1789127230.577296:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258973568 00000100:00100000:2.0:1789127230.577390:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:2.0:1789127230.577403:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+11:18973:x1876035258973568:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:2.0:1789127230.577430:0:23448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127230.577744:0:23448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eca8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca5b expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.577931:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.577950:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.577973:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.577987:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.577995:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.578002:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.578099:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ecaa0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.578109:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ecaa0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.578117:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ecaa0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127230.579013:0:23448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789127230.579017:0:23448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127230.579072:0:23448:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ecaa0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579089:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579095:0:23448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579102:0:23448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579108:0:23448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364cb200 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127230.579112:0:23448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579130:0:23448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579594:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994238d22200) 00010000:00010000:2.0:1789127230.579598:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127230.579605:0:23448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579613:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666eca92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579634:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579704:0:23448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579711:0:23448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579716:0:23448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127230.579720:0:23448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579727:0:23448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579735:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff994103eaa600) 00010000:00010000:2.0:1789127230.579738:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127230.579742:0:23448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579748:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666eca99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579793:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666eca8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca5b expref: 13 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579810:0:23448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca200/0xa840b4da666ecaa0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca5b expref: 12 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127230.579819:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:2.0:1789127230.579822:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789127230.579831:0:23448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca200, rc 0) 00000100:00100000:2.0:1789127230.579935:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+12:18973:x1876035258973568:12345-192.168.203.23@tcp:101:bash.0 Request processed in 2533us (2859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127230.579946:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 36 00000100:00100000:1.0:1789127230.588724:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.588883:0:23459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258973696 00000100:00100000:0.0:1789127230.588897:0:23459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258973696 00000100:00100000:0.0:1789127230.588974:0:23459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789127230.588986:0:23459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:18973:x1876035258973696:12345-192.168.203.23@tcp:900:bash.0 00000100:00100000:0.0:1789127230.589098:0:23459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:18973:x1876035258973696:12345-192.168.203.23@tcp:900:bash.0 Request processed in 113us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.589106:0:23459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789127230.601764:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.602116:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258973952 00000100:00100000:3.0:1789127230.602129:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258973952 00000100:00100000:3.0:1789127230.602300:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:3.0:1789127230.602313:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+12:18973:x1876035258973952:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789127230.602340:0:26359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127230.602366:0:26359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecaa7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca62 expref: -99 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.602585:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.602604:0:26359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca54 expref: 12 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.602614:0:26359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.602687:0:26359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca54 expref: 12 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.602703:0:26359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca54 expref: 12 pid: 23449 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127230.602740:0:26359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26359:1876035276903936:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789127230.602852:0:26359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942081c4600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127230.611773:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.611989:0:26359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:26359:1876035276903936:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789127230.612027:0:26359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127230.612790:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258974080 00000100:00100000:0.0:1789127230.612891:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258974080 00010000:00010000:0.0:1789127230.613010:0:23434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca54 expref: 13 pid: 23449 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127230.613103:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 16 00000100:00100000:0.0:1789127230.613115:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+13:2394:x1876035258974080:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127230.616288:0:23434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127230.616321:0:23434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca54 expref: 13 pid: 23449 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.616347:0:23434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca54 expref: 13 pid: 23449 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.616379:0:23434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666eca4c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca54 expref: 13 pid: 23449 timeout: 755 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.616429:0:23434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:0.0:1789127230.616435:0:23434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.616447:0:23434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.616467:0:23434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.616515:0:23434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127230.616608:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:20e4c89f-9d0f-4fa6-a881-4560a0c09634+12:2394:x1876035258974080:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 3493us (4846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.616622:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 16 00010000:00010000:3.0:1789127230.616811:0:26359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.616820:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617004:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617028:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617041:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617553:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617564:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617571:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127230.617599:0:26359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789127230.617625:0:26359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617632:0:26359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617639:0:26359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617645:0:26359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127230.617678:0:26359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617687:0:26359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617698:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:3.0:1789127230.617701:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127230.617706:0:26359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617712:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecaae lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127230.617726:0:26359:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e06120a8 reply state 00000000f9031b18 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617736:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617751:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff994238d22a00) 00010000:00010000:3.0:1789127230.617754:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127230.617756:0:26359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789127230.617792:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecaa7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca62 expref: 15 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617807:0:26359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca62 expref: 14 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.617814:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:3.0:1789127230.617816:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789127230.617819:0:26359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167e00, rc 0) 00000100:00100000:3.0:1789127230.617898:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+15:18973:x1876035258973952:12345-192.168.203.23@tcp:101:bash.0 Request processed in 15588us (16463us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1789127230.617907:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 37 00000100:00100000:0.0:1789127230.634886:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127230.634919:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99420aa81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276904064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127230.635027:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.635439:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276904064 00000100:00100000:3.0:1789127230.635451:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276904064 00000100:00100000:3.0:1789127230.635522:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127230.635533:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276904064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127230.635568:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00010000:00010000:2.0:1789127230.635601:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127230.635641:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276904064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.635677:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127230.635705:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276904192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127230.635733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.635761:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276904192 00000100:00100000:3.0:1789127230.635781:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276904192 00000100:00100000:3.0:1789127230.635947:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127230.635963:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276904192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127230.635974:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127230.636005:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276904192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.636011:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127230.636053:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423664de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276904192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127230.636104:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99420aa81e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276904064:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1789127230.636403:0:24206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789127230.636575:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276904448:0@lo:400:kworker.0 00000100:00100000:1.0:1789127230.636615:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276904320:0@lo:400:kworker.0 00000100:00100000:1.0:1789127230.636674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127230.636703:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276904832:0@lo:400:kworker.0 00000100:00100000:1.0:1789127230.636730:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276904576:0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.636732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.636760:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276904960:0@lo:400:kworker.0 00000100:00100000:1.0:1789127230.636793:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276904320 00000100:00100000:1.0:1789127230.636798:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276904320 00000100:00100000:1.0:1789127230.636835:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127230.636844:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276904320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127230.636885:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276904320:12345-0@lo:400:kworker.0 Request processed in 43us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.636892:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127230.636902:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127230.636917:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276904448 00000100:00100000:1.0:1789127230.636921:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276904448 00000100:00100000:3.0:1789127230.636925:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276905472:0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.636949:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127230.636961:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789127230.636969:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276904448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.636990:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276904960 00000100:00100000:3.0:1789127230.636993:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276904960 00000100:00100000:1.0:1789127230.637002:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276904448:12345-0@lo:400:kworker.0 Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.637008:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127230.637019:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276905472 00000100:00100000:3.0:1789127230.637022:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276905472 00000100:00100000:1.0:1789127230.637024:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.637045:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789127230.637051:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276904960:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789127230.637114:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127230.637120:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127230.637122:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127230.638519:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276905344:0@lo:400:kworker.0 00000100:00100000:2.0:1789127230.638645:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276904832 00000100:00100000:2.0:1789127230.638668:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276904832 00000100:00100000:2.0:1789127230.638732:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127230.638741:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276904832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.639223:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876035276904960:12345-0@lo:400:kworker.0 Request processed in 2169us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.639234:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789127230.639264:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127230.639274:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276905472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.639328:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876035276905472:12345-0@lo:400:kworker.0 Request processed in 56us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.639334:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127230.639385:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876035276904960:0@lo:400:kworker.0 00010000:00080000:3.0:1789127230.639403:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104af8b40 x1876035276905472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127230.639415:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1876035276905472:0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.639429:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276904448:0@lo:400:kworker.0 00000100:00100000:0.0:1789127230.639712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.640019:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258974208 00000100:00100000:3.0:1789127230.640026:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258974208 00000100:00100000:3.0:1789127230.640082:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1789127230.640090:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+15:18973:x1876035258974208:12345-192.168.203.23@tcp:101:bash.0 00010000:00010000:3.0:1789127230.640111:0:26359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127230.640136:0:26359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecaca lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca69 expref: -99 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.640218:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.640235:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.640247:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127230.640308:0:26359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789127230.640321:0:26359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127230.640346:0:26359:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.640359:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.640388:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecaca lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca69 expref: 17 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.640410:0:26359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca69 expref: 16 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.640420:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:3.0:1789127230.640423:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127230.640428:0:26359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167600, rc 0) 00000100:00100000:3.0:1789127230.640486:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+16:18973:x1876035258974208:12345-192.168.203.23@tcp:101:bash.0 Request processed in 397us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.640492:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 38 00000100:00100000:3.0:1789127230.640731:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127230.640777:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276905088:0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.641317:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127230.641388:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127230.641405:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276904576 00000100:00100000:3.0:1789127230.641410:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276904576 00000100:00100000:3.0:1789127230.641449:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276905088 00000100:00100000:3.0:1789127230.641451:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276905088 00000100:00100000:3.0:1789127230.641476:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127230.641484:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276904576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.641532:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1876035276904576:12345-0@lo:400:kworker.0 Request processed in 49us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.641552:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127230.641567:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127230.641573:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276905088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.641607:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1876035276905088:12345-0@lo:400:kworker.0 Request processed in 33us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.641629:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789127230.641669:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127230.641702:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1876035276904576:0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.641713:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1876035276905088:0@lo:400:kworker.0 00000100:00100000:0.0:1789127230.643917:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276904704:0@lo:400:kworker.0 00000100:00100000:0.0:1789127230.644010:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127230.644057:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276905216:0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.644237:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276904704 00000100:00100000:3.0:1789127230.644246:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276904704 00000100:00100000:3.0:1789127230.644308:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127230.644319:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420a88d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276904704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.644383:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420a88d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276904704:12345-0@lo:400:kworker.0 Request processed in 66us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.644391:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789127230.644536:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127230.644594:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276904704:0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.644757:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276905216 00000100:00100000:3.0:1789127230.644762:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276905216 00000100:00100000:3.0:1789127230.644815:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127230.644822:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276905216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.644861:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876035276905216:12345-0@lo:400:kworker.0 Request processed in 38us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127230.644866:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789127230.645676:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789127230.645739:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994104afa940 x1876035276905216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127230.645754:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104afa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1876035276905216:0@lo:400:kworker.0 00000100:00100000:0.0:1789127230.646760:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127230.646805:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127230.646944:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276905344 00000100:00100000:1.0:1789127230.646959:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276905344 00000100:00100000:3.0:1789127230.646980:0:23450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258974464 00000100:00100000:3.0:1789127230.646985:0:23450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258974464 00000100:00100000:3.0:1789127230.647029:0:23450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00100000:1.0:1789127230.647029:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789127230.647039:0:23450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+16:18973:x1876035258974464:12345-192.168.203.23@tcp:35:bash.0 00000100:00100000:1.0:1789127230.647039:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276905344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127230.647096:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876035276905344:12345-0@lo:400:kworker.0 Request processed in 59us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.647104:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789127230.647156:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1876035276905344:0@lo:400:kworker.0 00000100:00100000:1.0:1789127230.647189:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276904320:0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.647420:0:23450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+17:18973:x1876035258974464:12345-192.168.203.23@tcp:35:bash.0 Request processed in 381us (667us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1789127230.647429:0:23450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 5 00000100:00080000:0.0:1789127230.647597:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127230.649213:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276904832:12345-0@lo:400:kworker.0 Request processed in 10464us (12178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127230.649229:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789127230.651191:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276904832:0@lo:400:kworker.0 00000100:00100000:3.0:1789127230.744259:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.744451:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258974720 00000100:00100000:0.0:1789127230.744464:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258974720 00000100:00100000:0.0:1789127230.744542:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:0.0:1789127230.744554:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+17:18983:x1876035258974720:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:0.0:1789127230.744587:0:23447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127230.744632:0:23447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca70 expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127230.744815:0:23447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789127230.744944:0:23447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecad8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca70 expref: 19 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.744970:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994238d22200) 00010000:00010000:0.0:1789127230.744973:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127230.744980:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca70 expref: 19 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.744997:0:23447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe1000, rc 0) 00000100:00100000:0.0:1789127230.745081:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+18:18983:x1876035258974720:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 529us (838us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1789127230.745091:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 39 00000100:00100000:1.0:1789127230.747831:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.747928:0:23450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258974976 00000100:00100000:3.0:1789127230.747939:0:23450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258974976 00000100:00100000:3.0:1789127230.748027:0:23450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:3.0:1789127230.748040:0:23450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+18:18983:x1876035258974976:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:3.0:1789127230.748343:0:23450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+19:18983:x1876035258974976:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 305us (524us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1789127230.748353:0:23450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 6 00000100:00100000:2.0:1789127230.786342:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127230.786452:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258975232 00000100:00100000:3.0:1789127230.786466:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258975232 00000100:00100000:3.0:1789127230.786541:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:3.0:1789127230.786554:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+19:18986:x1876035258975232:12345-192.168.203.23@tcp:101:lfs.0 00010000:00010000:3.0:1789127230.786586:0:24979:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127230.786615:0:24979:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecae6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca77 expref: -99 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.786791:0:24979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecaed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.786810:0:24979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24979 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.786847:0:24979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24979 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127230.786862:0:24979:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789127230.787201:0:24979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecae6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca77 expref: 22 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.787225:0:24979:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecaed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca77 expref: 21 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127230.787235:0:24979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:3.0:1789127230.787238:0:24979:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127230.787243:0:24979:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166e00, rc 0) 00000100:00100000:3.0:1789127230.787335:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423664de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+21:18986:x1876035258975232:12345-192.168.203.23@tcp:101:lfs.0 Request processed in 784us (1009us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1789127230.787344:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 40 00000100:00100000:2.0:1789127230.797132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.797313:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258975488 00000100:00100000:0.0:1789127230.797345:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258975488 00000100:00100000:0.0:1789127230.797441:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1789127230.797454:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104062d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+21:2391:x1876035258975488:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127230.797475:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127230.797513:0:23433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecaed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca77 expref: 21 pid: 24979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127230.797538:0:23433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:0.0:1789127230.797544:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127230.797618:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104062d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+20:2391:x1876035258975488:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 166us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127230.797627:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:0.0:1789127230.801419:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127230.801522:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258975360 00000100:00100000:1.0:1789127230.801537:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258975360 00000100:00100000:1.0:1789127230.801614:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:1.0:1789127230.801627:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+20:18986:x1876035258975360:12345-192.168.203.23@tcp:54:lfs.0 00010000:00010000:1.0:1789127230.801761:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.801783:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.801798:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.801855:0:26359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.801864:0:26359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.801871:0:26359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.801878:0:26359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127230.801884:0:26359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.801893:0:26359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.801928:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:1.0:1789127230.801931:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127230.801938:0:26359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127230.801945:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecafb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127230.802048:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+20:18986:x1876035258975360:12345-192.168.203.23@tcp:54:lfs.0 Request processed in 422us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127230.802057:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 41 00000100:00100000:2.0:1789127230.806359:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127230.806476:0:23451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258975744 00000100:00100000:0.0:1789127230.806490:0:23451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258975744 00000100:00100000:0.0:1789127230.806589:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 7 00000100:00100000:0.0:1789127230.806602:0:23451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+20:18986:x1876035258975744:12345-192.168.203.23@tcp:35:lfs.0 00000100:00100000:0.0:1789127230.807778:0:23451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+21:18986:x1876035258975744:12345-192.168.203.23@tcp:35:lfs.0 Request processed in 1170us (1428us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1789127230.807791:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 7 00000040:00080000:2.0:1789127230.955571:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789127231.050802:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127231.050922:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258976000 00000100:00100000:0.0:1789127231.050932:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258976000 00000100:00100000:0.0:1789127231.051056:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:0.0:1789127231.051067:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104062580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+21:19017:x1876035258976000:12345-192.168.203.23@tcp:101:cat.0 00010000:00010000:0.0:1789127231.051093:0:23447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127231.051115:0:23447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb02 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca7e expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.051231:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1800/0xa840b4da666ecb09 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.051245:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1800/0xa840b4da666ecb09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.051257:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1800/0xa840b4da666ecb09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127231.051268:0:23447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789127231.051387:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb02 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca7e expref: 24 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.051407:0:23447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1800/0xa840b4da666ecb09 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca7e expref: 23 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.051416:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:0.0:1789127231.051419:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127231.051422:0:23447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe1800, rc 0) 00000100:00100000:0.0:1789127231.051483:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104062580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+23:19017:x1876035258976000:12345-192.168.203.23@tcp:101:cat.0 Request processed in 418us (690us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1789127231.051491:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 42 00000100:00100000:1.0:1789127231.056422:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127231.056515:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258976128 00000100:00100000:3.0:1789127231.056525:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258976128 00000100:00100000:3.0:1789127231.056748:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:3.0:1789127231.056760:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+23:2391:x1876035258976128:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127231.056779:0:24204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127231.056802:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1800/0xa840b4da666ecb09 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca7e expref: 23 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.056822:0:24204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:3.0:1789127231.056827:0:24204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127231.056897:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+22:2391:x1876035258976128:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 139us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127231.056905:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:2.0:1789127231.061600:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127231.061705:0:23451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258976384 00000100:00100000:0.0:1789127231.061715:0:23451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258976384 00000100:00100000:0.0:1789127231.061765:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:0.0:1789127231.061775:0:23451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+22:19017:x1876035258976384:12345-192.168.203.23@tcp:35:cat.0 00000100:00100000:0.0:1789127231.062086:0:23451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+23:19017:x1876035258976384:12345-192.168.203.23@tcp:35:cat.0 Request processed in 301us (483us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1789127231.062111:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 8 00000100:00100000:2.0:1789127231.138203:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127231.140682:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258976640 00000100:00100000:1.0:1789127231.140696:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258976640 00000100:00100000:1.0:1789127231.140776:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:1.0:1789127231.140787:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+23:19023:x1876035258976640:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:1.0:1789127231.140813:0:23449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127231.140837:0:23449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ecb17 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca85 expref: -99 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.140967:0:23449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.140982:0:23449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca62 expref: 24 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.140991:0:23449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca69 expref: 24 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.141017:0:23449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.141052:0:23449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca69 expref: 24 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.141066:0:23449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca69 expref: 24 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127231.141193:0:23449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276905600:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789127231.141291:0:23449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca62 expref: 24 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.141300:0:23449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca62 expref: 24 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127231.141309:0:23449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276905728:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789127231.141331:0:23449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942017f9540 going to sleep for 11 seconds 00000100:00100000:1.0:1789127231.144920:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127231.146181:0:23449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276905600:192.168.203.23@tcp:104: 00000100:00100000:3.0:1789127231.146193:0:23449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276905728:192.168.203.23@tcp:104: 00010000:00010000:3.0:1789127231.146220:0:23449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127231.146417:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258976768 00000100:00100000:0.0:1789127231.146424:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258976768 00010000:00010000:0.0:1789127231.146463:0:23433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca69 expref: 25 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127231.146506:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:0.0:1789127231.146516:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+25:2394:x1876035258976768:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127231.146530:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127231.146536:0:23433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca69 expref: 25 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.146548:0:23433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca69 expref: 25 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.146570:0:23433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecad1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca69 expref: 25 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.146586:0:23433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:0.0:1789127231.146592:0:23433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.146600:0:23433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.146607:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127231.146737:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+24:2394:x1876035258976768:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 222us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127231.146760:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 17 00000100:00100000:2.0:1789127231.147848:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127231.147930:0:23434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258976896 00000100:00100000:0.0:1789127231.147936:0:23434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258976896 00010000:00010000:0.0:1789127231.148091:0:23434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca62 expref: 24 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127231.148128:0:23434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 18 00000100:00100000:0.0:1789127231.148137:0:23434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+24:2394:x1876035258976896:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127231.148149:0:23434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127231.148155:0:23434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca62 expref: 24 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.148166:0:23434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca62 expref: 24 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.148184:0:23434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecabc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca62 expref: 24 pid: 26359 timeout: 756 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.148200:0:23434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:0.0:1789127231.148205:0:23434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.148213:0:23434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.148220:0:23434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.149471:0:23434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127231.149547:0:23434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942345eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+23:2394:x1876035258976896:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 1408us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127231.149559:0:23434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 18 00010000:00010000:1.0:1789127231.150508:0:23449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.150518:0:23449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127231.150539:0:23449:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789127231.150826:0:23449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ecb17 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca85 expref: 24 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.150861:0:23449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3400/0xa840b4da666ecb1e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca85 expref: 23 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.150869:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:1.0:1789127231.150872:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789127231.150875:0:23449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3400, rc 0) 00000100:00100000:1.0:1789127231.150916:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+23:19023:x1876035258976640:12345-192.168.203.23@tcp:101:dd.0 Request processed in 10132us (12723us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1789127231.150924:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 43 00000100:00100000:2.0:1789127231.155184:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127231.156121:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258977024 00000100:00100000:3.0:1789127231.156131:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258977024 00000100:00100000:3.0:1789127231.156193:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:3.0:1789127231.156203:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+23:19023:x1876035258977024:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:3.0:1789127231.156223:0:23448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127231.156242:0:23448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb2c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca8c expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.156273:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.156285:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.156295:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.156422:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb2c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca8c expref: 25 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.156438:0:23448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca8c expref: 24 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.156452:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:3.0:1789127231.156455:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789127231.156458:0:23448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212166000, rc 0) 00000100:00100000:3.0:1789127231.156912:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+24:19023:x1876035258977024:12345-192.168.203.23@tcp:101:dd.0 Request processed in 709us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127231.156919:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 44 00000100:00100000:2.0:1789127231.161210:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127231.161294:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258977280 00000100:00100000:0.0:1789127231.161419:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258977280 00000100:00100000:0.0:1789127231.161481:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 45 00000100:00100000:0.0:1789127231.161492:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+24:19023:x1876035258977280:12345-192.168.203.23@tcp:36:dd.0 00010000:00010000:0.0:1789127231.161938:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.162030:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.162042:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127231.162089:0:23447:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1789127231.162112:0:23447:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005217ff18 reply state 000000009fc4f466 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.162124:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.162132:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:0.0:1789127231.162134:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127231.162138:0:23447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127231.162233:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+27:19023:x1876035258977280:12345-192.168.203.23@tcp:36:dd.0 Request processed in 743us (1033us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1789127231.162251:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 45 00000020:00080000:0.0:1789127231.162256:0:23447:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789127231.164472:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127231.167882:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258977408 00000100:00100000:1.0:1789127231.167896:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258977408 00000100:00100000:1.0:1789127231.167980:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:1.0:1789127231.167990:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+27:19023:x1876035258977408:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:1.0:1789127231.168014:0:23449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127231.168037:0:23449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ecb41 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca93 expref: -99 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.168108:0:23449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ecb41 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca93 expref: 28 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.168124:0:23449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ecb41 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca93 expref: 28 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127231.168142:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:1.0:1789127231.168146:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127231.168164:0:23449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3a00, rc 0) 00000100:00100000:1.0:1789127231.168233:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ec5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+28:19023:x1876035258977408:12345-192.168.203.23@tcp:101:dd.0 Request processed in 244us (3768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127231.168240:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 46 00000100:00100000:2.0:1789127231.199491:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127231.199639:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258977664 00000100:00100000:0.0:1789127231.199679:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258977664 00000100:00100000:0.0:1789127231.199749:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:0.0:1789127231.199759:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+28:19023:x1876035258977664:12345-192.168.203.23@tcp:103:dd.0 00010000:00010000:0.0:1789127231.199775:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127231.199812:0:23433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e3a00/0xa840b4da666ecb41 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca93 expref: 28 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127231.199831:0:23433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:0.0:1789127231.199837:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127231.199891:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+27:19023:x1876035258977664:12345-192.168.203.23@tcp:103:dd.0 Request processed in 133us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127231.199899:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 2 00000100:00100000:2.0:1789127231.201761:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127231.201845:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258977792 00000100:00100000:3.0:1789127231.201853:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258977792 00000100:00100000:3.0:1789127231.201902:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:3.0:1789127231.201912:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+27:19023:x1876035258977792:12345-192.168.203.23@tcp:58:dd.0 00010000:00010000:3.0:1789127231.202022:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.202038:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.202050:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127231.203488:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127231.203626:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1789127231.204151:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1789127231.204389:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+27:19023:x1876035258977792:12345-192.168.203.23@tcp:58:dd.0 Request processed in 2469us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127231.204405:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 47 00000100:00100000:2.0:1789127231.207841:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127231.208036:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258977920 00000100:00100000:3.0:1789127231.208050:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258977920 00000100:00100000:3.0:1789127231.208195:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 48 00000100:00100000:3.0:1789127231.208209:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+27:19023:x1876035258977920:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:3.0:1789127231.208240:0:26359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127231.208269:0:26359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ecb4f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1ca9a expref: -99 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.208349:0:26359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.208363:0:26359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ecb4f lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca9a expref: 28 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.208391:0:26359:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.208471:0:26359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ecb4f lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca9a expref: 28 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.208490:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:3.0:1789127231.208493:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127231.208498:0:26359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ecb4f lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca9a expref: 28 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127231.208507:0:26359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994212167400, rc 0) 00000100:00100000:3.0:1789127231.208585:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994219ee1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+28:19023:x1876035258977920:12345-192.168.203.23@tcp:101:dd.0 Request processed in 379us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127231.208593:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 48 00010000:00010000:2.0:1789127231.660856:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127231.660916:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127231.660960:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276905856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127231.661064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127231.662628:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276905856 00000100:00100000:2.0:1789127231.662747:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276905856 00000100:00100000:2.0:1789127231.662896:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127231.662908:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276905856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127231.662966:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1789127231.663091:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276905856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127231.663100:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127231.663179:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276905856:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789127231.979222:0:23484:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789127231.979236:0:23484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127231.979272:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789127231.979285:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789127231.979466:0:23484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23484:1876035276905984:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127231.982087:0:23484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942313e96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127231.994413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127231.994559:0:23484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ee0f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23484:1876035276905984:192.168.203.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789127232.002940:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258978048 00000100:00100000:3.0:1789127232.002989:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258978048 00000100:00100000:1.0:1789127232.003259:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:1.0:1789127232.003275:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+28:19024:x1876035258978048:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789127232.003318:0:23447:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789127232.003539:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+28:19024:x1876035258978048:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 268us (9140us total) trans 0 rc 0/0 00000100:00080000:0.0:1789127232.003540:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127232.003553:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 49 00000100:00100000:0.0:1789127232.024815:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.024930:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258978176 00000100:00100000:3.0:1789127232.024958:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258978176 00000100:00100000:3.0:1789127232.025035:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:3.0:1789127232.025046:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+28:19024:x1876035258978176:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789127232.026709:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.026736:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.026756:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.026780:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.026787:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.026803:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.026835:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.026845:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.026851:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127232.029237:0:23448:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789127232.029324:0:23448:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127232.029352:0:23448:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029373:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029381:0:23448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029389:0:23448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029396:0:23448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127232.029401:0:23448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029409:0:23448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029429:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994238d22d00) 00010000:00010000:3.0:1789127232.029432:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127232.029438:0:23448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029445:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167e00/0xa840b4da666ecb56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029465:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029471:0:23448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029487:0:23448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029493:0:23448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127232.029496:0:23448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029501:0:23448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029509:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff994238d22f00) 00010000:00010000:3.0:1789127232.029511:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127232.029514:0:23448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029519:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb5d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029537:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029543:0:23448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029550:0:23448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029554:0:23448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127232.029557:0:23448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029570:0:23448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029578:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:3.0:1789127232.029580:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127232.029583:0:23448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.029588:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb64 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127232.029912:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+28:19024:x1876035258978176:12345-192.168.203.23@tcp:34:lhsmtool_posix.0 Request processed in 4855us (5112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127232.029928:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 50 00000100:00100000:2.0:1789127232.040272:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.040615:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258978432 00000100:00100000:3.0:1789127232.040624:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258978432 00000100:00100000:2.0:1789127232.041645:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:2.0:1789127232.041683:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+28:19024:x1876035258978432:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127232.041705:0:26359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127232.041726:0:26359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ecb6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1caa1 expref: -99 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.041836:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.041852:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.041862:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127232.041893:0:26359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789127232.041981:0:26359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.041990:0:26359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.041996:0:26359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.042002:0:26359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9942364ca400 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:2.0:1789127232.042006:0:26359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.042014:0:26359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.042026:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:2.0:1789127232.042028:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789127232.042033:0:26359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.042038:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecb72 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.042083:0:26359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ecb6b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1caa1 expref: 30 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.042094:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994238d22d00) 00010000:00010000:2.0:1789127232.042097:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127232.042108:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ecb6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1caa1 expref: 30 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.042119:0:26359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb600, rc 0) 00000100:00100000:2.0:1789127232.042189:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+29:19024:x1876035258978432:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 511us (1928us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1789127232.042197:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 51 00000100:00100000:1.0:1789127232.056639:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.061557:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258978560 00000100:00100000:0.0:1789127232.061572:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258978560 00000100:00100000:1.0:1789127232.061852:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:1.0:1789127232.061865:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+29:19024:x1876035258978560:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789127232.061901:0:23447:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789127232.062045:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+29:19024:x1876035258978560:12345-192.168.203.23@tcp:53:lhsmtool_posix.0 Request processed in 182us (5415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127232.062061:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 52 00000100:00100000:3.0:1789127232.072152:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.075028:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258978816 00000100:00100000:0.0:1789127232.075043:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258978816 00000100:00100000:0.0:1789127232.075159:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1789127232.075169:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+29:19024:x1876035258978816:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127232.075191:0:23448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127232.075213:0:23448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecb80 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1caa8 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127232.076171:0:23448:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:0.0:1789127232.076179:0:23448:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1789127232.076201:0:23448:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1789127232.076343:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ecb87 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.076358:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ecb87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.076369:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ecb87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.076938:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecb80 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1caa8 expref: 32 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.076967:0:23448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ecb87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1caa8 expref: 31 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.076977:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6600) 00010000:00010000:0.0:1789127232.076980:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127232.076984:0:23448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe0800, rc 0) 00000100:00100000:0.0:1789127232.077046:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+31:19024:x1876035258978816:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 1878us (4903us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1789127232.078024:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:1.0:1789127232.082093:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.082328:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258979072 00000100:00100000:3.0:1789127232.082337:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258979072 00000100:00100000:3.0:1789127232.082405:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:3.0:1789127232.082416:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+31:19024:x1876035258979072:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127232.082484:0:26359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127232.082513:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0800/0xa840b4da666ecb87 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1caa8 expref: 31 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082534:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6600) 00010000:00010000:3.0:1789127232.082545:0:26359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127232.082569:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082598:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082608:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082625:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082632:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082638:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082723:0:26359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082731:0:26359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082739:0:26359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082745:0:26359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127232.082749:0:26359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082756:0:26359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.082777:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:3.0:1789127232.083044:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127232.083052:0:26359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.083173:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166e00/0xa840b4da666ecb95 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.083186:0:26359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.083191:0:26359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.083197:0:26359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.083202:0:26359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167600 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127232.083205:0:26359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.083210:0:26359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.083218:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x8ff1a174 (ffff994238d22f00) 00010000:00010000:3.0:1789127232.083220:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127232.083223:0:26359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.083228:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167600/0xa840b4da666ecb9c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x8ff1a174 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127232.100302:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+30:19024:x1876035258979072:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 17874us (18204us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789127232.100332:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:3.0:1789127232.103323:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.103614:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258979200 00000100:00100000:0.0:1789127232.103625:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258979200 00000100:00100000:0.0:1789127232.103716:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:0.0:1789127232.103727:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99420aa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+30:19024:x1876035258979200:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127232.103751:0:23449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127232.103787:0:23449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecba3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1caaf expref: -99 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.103833:0:23449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ecbaa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.103847:0:23449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ecbaa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.103859:0:23449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ecbaa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.103987:0:23449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecba3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1caaf expref: 32 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.104005:0:23449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1600/0xa840b4da666ecbaa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1caaf expref: 31 pid: 23449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.104013:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00010000:00010000:0.0:1789127232.104016:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127232.104020:0:23449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe1600, rc 0) 00000100:00100000:0.0:1789127232.104294:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99420aa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+31:19024:x1876035258979200:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 568us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127232.104309:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:2.0:1789127232.116954:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.117048:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258979456 00000100:00100000:0.0:1789127232.117068:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258979456 00000100:00100000:0.0:1789127232.117131:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:0.0:1789127232.117141:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+31:19024:x1876035258979456:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127232.117217:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.117234:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.117245:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127232.117403:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1789127232.117414:0:23448:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 657321765011ns, next at 658321762056ns, rc = 0 00000004:00010000:0.0:1789127232.117479:0:23448:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f605dbdd reply state 00000000b0007f67 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.117492:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.117500:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00010000:00010000:0.0:1789127232.117503:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789127232.117506:0:23448:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127232.117606:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+33:19024:x1876035258979456:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 466us (670us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789127232.117613:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:3.0:1789127232.132626:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127232.132846:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258979584 00000100:00100000:2.0:1789127232.132857:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258979584 00000100:00100000:2.0:1789127232.132917:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:2.0:1789127232.132927:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+33:19024:x1876035258979584:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127232.132973:0:26359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127232.132994:0:26359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1cab6 expref: -99 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.133048:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cab6 expref: 34 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.133067:0:26359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cab6 expref: 34 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.133083:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00010000:00010000:2.0:1789127232.133087:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127232.133090:0:26359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364cb200, rc 0) 00000100:00100000:2.0:1789127232.133142:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+34:19024:x1876035258979584:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 217us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127232.133166:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 57 00000100:00100000:3.0:1789127232.142515:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127232.142674:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258979712 00000100:00100000:1.0:1789127232.142683:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258979712 00000100:00100000:1.0:1789127232.142752:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00100000:1.0:1789127232.142768:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2393:x1876035258979712:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789127232.143030:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104019680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:2393:x1876035258979712:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 270us (525us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1789127232.143037:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 26 00000100:00080000:0.0:1789127232.144170:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127232.156364:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127232.156567:0:23451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258979968 00000100:00100000:2.0:1789127232.156577:0:23451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258979968 00000100:00100000:2.0:1789127232.156718:0:23451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:2.0:1789127232.156728:0:23451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+34:19024:x1876035258979968:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789127232.156952:0:23451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+35:19024:x1876035258979968:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 216us (599us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1789127232.156960:0:23451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 9 00000100:00100000:0.0:1789127232.161449:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.161620:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258980224 00000100:00100000:3.0:1789127232.161629:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258980224 00000100:00100000:3.0:1789127232.161715:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:3.0:1789127232.161727:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+35:19024:x1876035258980224:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789127232.162037:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+35:19024:x1876035258980224:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 311us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127232.162045:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 58 00000100:00100000:1.0:1789127232.166579:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:2.0:1789127232.168702:0:23447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258980352 00000100:00100000:2.0:1789127232.168716:0:23447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258980352 00000100:00100000:2.0:1789127232.168795:0:23447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:2.0:1789127232.168814:0:23447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+35:19024:x1876035258980352:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127232.168836:0:23447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127232.168857:0:23447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ecbbf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1cabd expref: -99 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.169007:0:23447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecbc6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.169023:0:23447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecbc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.169035:0:23447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecbc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127232.169081:0:23447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127232.169098:0:23447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecbc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.169141:0:23447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb600/0xa840b4da666ecbbf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cabd expref: 37 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.169163:0:23447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecbc6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cabd expref: 36 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.169173:0:23447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00010000:00010000:2.0:1789127232.169176:0:23447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789127232.169180:0:23447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9942364ca400, rc 0) 00000100:00100000:2.0:1789127232.169248:0:23447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+36:19024:x1876035258980352:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 444us (2677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127232.169255:0:23447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 59 00000100:00100000:2.0:1789127232.172632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127232.173446:0:25262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258980480 00000100:00100000:1.0:1789127232.173457:0:25262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258980480 00000100:00100000:1.0:1789127232.173520:0:25262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:1.0:1789127232.173530:0:25262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410501c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+6:2393:x1876035258980480:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127232.173551:0:25262:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127232.173572:0:25262:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1cac4 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127232.173753:0:25262:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3ea3f, blocks: 0x0 00010000:00010000:1.0:1789127232.173770:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1789127232.173774:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127232.173782:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cac4 expref: 7 pid: 25262 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.173924:0:25262:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cac4 expref: 7 pid: 25262 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.173951:0:25262:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99422f9e3c00, rc 0) 00000100:00100000:1.0:1789127232.174016:0:25262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410501c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:2393:x1876035258980480:12345-192.168.203.23@tcp:101:lhsmtool_posix.0 Request processed in 487us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127232.174031:0:25262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 27 00000100:00100000:0.0:1789127232.177145:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.177230:0:24979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258980736 00000100:00100000:3.0:1789127232.177238:0:24979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258980736 00000100:00100000:3.0:1789127232.177297:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:3.0:1789127232.177307:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+36:19024:x1876035258980736:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789127232.177432:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+36:19024:x1876035258980736:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127232.177441:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 60 00000100:00100000:3.0:1789127232.180486:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.180584:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258980864 00000100:00100000:0.0:1789127232.180593:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258980864 00000100:00100000:0.0:1789127232.180697:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:0.0:1789127232.180713:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+36:19024:x1876035258980864:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789127232.183005:0:23427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1789127232.183019:0:23427:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:1.0:1789127232.183210:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183223:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183243:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183251:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127232.183255:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183263:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183279:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff994103eaa600) 00010000:00010000:1.0:1789127232.183282:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127232.183287:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183294:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030800/0xa840b4da666ec9ce lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183316:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183323:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183329:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183334:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994200030c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127232.183337:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183354:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183363:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:1.0:1789127232.183366:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127232.183368:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183373:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994200030c00/0xa840b4da666ec9d5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183385:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183392:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183398:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183402:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167c00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127232.183404:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183409:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183416:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff994238d22a00) 00010000:00010000:1.0:1789127232.183419:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127232.183422:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183435:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167c00/0xa840b4da666ecab5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183453:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183460:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183466:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183473:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1e00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127232.183477:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183483:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183492:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:1.0:1789127232.183495:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127232.183498:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183504:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1e00/0xa840b4da666ecb3a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183515:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183521:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183533:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183538:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe0000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127232.183541:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183547:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183554:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00010000:00010000:1.0:1789127232.183557:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789127232.183560:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.183566:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbb1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127232.183580:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127232.183594:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276906112:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1789127232.183919:0:23427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1789127232.184153:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.184162:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.184169:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.184178:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:3.0:1789127232.184181:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.184187:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.184197:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff994103eaa500) 00010000:00010000:3.0:1789127232.184199:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789127232.184202:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.184209:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666eca22 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127232.184232:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+15:19024:x1876035258980864:12345-192.168.203.23@tcp:44:lhsmtool_posix.0 Request processed in 3523us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127232.184244:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 61 00000100:00100000:1.0:1789127232.185144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127232.185248:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276906112 00000100:00100000:3.0:1789127232.185255:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276906112 00000100:00100000:3.0:1789127232.185316:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127232.185326:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276906112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789127232.185451:0:24959:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789127232.185455:0:24959:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789127232.185457:0:24959:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789127232.185460:0:24959:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789127231 -> 1789127231 00002000:00010000:3.0:1789127232.185462:0:24959:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789127232.185524:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1876035276906112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (382us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1789127232.185532:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:1.0:1789127232.185669:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99422fa4d680/2, rc 0, transno 12884901892 00000100:00100000:1.0:1789127232.185675:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99422fa4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276906112:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1789127232.186327:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127232.187994:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.188132:0:24960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258980992 00000100:00100000:3.0:1789127232.188153:0:24960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258980992 00000100:00100000:3.0:1789127232.188208:0:24960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:3.0:1789127232.188218:0:24960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:2394:x1876035258980992:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789127232.188312:0:24960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:2394:x1876035258980992:12345-192.168.203.23@tcp:16:lhsmtool_posix.0 Request processed in 96us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127232.188317:0:24960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 29 00000100:00100000:2.0:1789127232.190033:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.190486:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258981248 00000100:00100000:3.0:1789127232.190492:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258981248 00000100:00100000:3.0:1789127232.190577:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:3.0:1789127232.190584:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+15:19024:x1876035258981248:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127232.190639:0:26359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127232.190693:0:26359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364ca400/0xa840b4da666ecbc6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cabd expref: 15 pid: 23447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.190713:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00010000:00010000:3.0:1789127232.190719:0:26359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127232.190744:0:26359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ecbd4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.190755:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ecbd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.190762:0:26359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ecbd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127232.190877:0:26359:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009a03a672 reply state 00000000988a650a transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ecbd4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.190889:0:26359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167a00/0xa840b4da666ecbd4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.190902:0:26359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00010000:00010000:3.0:1789127232.190904:0:26359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127232.190907:0:26359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127232.191003:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+16:19024:x1876035258981248:12345-192.168.203.23@tcp:36:lhsmtool_posix.0 Request processed in 418us (974us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1789127232.191010:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 62 00000100:00100000:1.0:1789127232.192739:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.192904:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258981376 00000100:00100000:3.0:1789127232.192913:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258981376 00000100:00100000:3.0:1789127232.193008:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:3.0:1789127232.193018:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:2392:x1876035258981376:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789127232.193130:0:24958:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789127232.193134:0:24958:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789127230 00002000:00010000:3.0:1789127232.193136:0:24958:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789127230 00002000:00010000:3.0:1789127232.193138:0:24958:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789127231 -> 1789127230 00002000:00010000:3.0:1789127232.193141:0:24958:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789127232.193195:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+8:2392:x1876035258981376:12345-192.168.203.23@tcp:2:lhsmtool_posix.0 Request processed in 179us (463us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789127232.193203:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 30 00000100:00100000:2.0:1789127232.198172:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127232.198242:0:25262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258981504 00000100:00100000:1.0:1789127232.198253:0:25262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258981504 00000100:00100000:1.0:1789127232.198301:0:25262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:1.0:1789127232.198311:0:25262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+8:2394:x1876035258981504:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789127232.198367:0:25262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.198383:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127232.198387:0:25262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127232.198393:0:25262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.198406:0:25262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.198432:0:25262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.198441:0:25262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.198450:0:25262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.198457:0:25262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e3000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127232.198462:0:25262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.198471:0:25262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.198499:0:25262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.198507:0:25262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ff2a0db/0xa840b4da666ecbdb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127232.198640:0:25262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+8:2394:x1876035258981504:12345-192.168.203.23@tcp:1:lhsmtool_posix.0 Request processed in 328us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127232.198691:0:25262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 31 00000100:00100000:2.0:1789127232.201833:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.201949:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258981760 00000100:00100000:0.0:1789127232.201958:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258981760 00000100:00100000:0.0:1789127232.202046:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 63 00000100:00100000:0.0:1789127232.202056:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+16:19024:x1876035258981760:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789127232.202128:0:23449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.202144:0:23449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca8c expref: 16 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.202152:0:23449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.202182:0:23449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca8c expref: 16 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.202209:0:23449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca8c expref: 16 pid: 23448 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127232.202224:0:23449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423cba21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276906240:192.168.203.23@tcp:104: 00000100:00100000:0.0:1789127232.202305:0:23449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9941030d6240 going to sleep for 11 seconds 00000100:00100000:2.0:1789127232.204956:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.204957:0:23449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423cba21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276906240:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789127232.204987:0:23449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127232.205137:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258981888 00000100:00100000:3.0:1789127232.205145:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258981888 00010000:00010000:3.0:1789127232.205178:0:24204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca8c expref: 17 pid: 23448 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127232.205215:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 19 00000100:00100000:3.0:1789127232.205223:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+17:2393:x1876035258981888:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127232.205235:0:24204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127232.205253:0:24204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca8c expref: 17 pid: 23448 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.205264:0:24204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca8c expref: 17 pid: 23448 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.205285:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecb33 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca8c expref: 17 pid: 23448 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.205300:0:24204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:3.0:1789127232.205306:0:24204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ecb4f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca9a expref: 16 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.205315:0:24204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.205323:0:24204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.205330:0:24204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.205389:0:24204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127232.205464:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+16:2393:x1876035258981888:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 241us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127232.205472:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 19 00010000:00010000:1.0:1789127232.205602:0:23449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.205609:0:23449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.205816:0:23449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.205827:0:23449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cab6 expref: 16 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.205836:0:23449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.205859:0:23449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cab6 expref: 16 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.205872:0:23449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cab6 expref: 16 pid: 26359 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127232.205891:0:23449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276906368:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789127232.205935:0:23449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942017f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127232.210108:0:23449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276906368:192.168.203.23@tcp:104: 00010000:00010000:0.0:1789127232.210135:0:23449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127232.210199:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.210237:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258982016 00000100:00100000:0.0:1789127232.210244:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258982016 00010000:00010000:0.0:1789127232.210337:0:23433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cab6 expref: 17 pid: 26359 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127232.210377:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1789127232.210388:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104afb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+17:2394:x1876035258982016:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127232.210403:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127232.210411:0:23433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cab6 expref: 17 pid: 26359 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.210423:0:23433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cab6 expref: 17 pid: 26359 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.210458:0:23433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9942364cb200/0xa840b4da666ecbb8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cab6 expref: 17 pid: 26359 timeout: 757 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.210473:0:23433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00010000:00010000:0.0:1789127232.210478:0:23433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.210488:0:23433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.210496:0:23433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.210519:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127232.210550:0:23449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.210560:0:23449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127232.210569:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104afb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+16:2394:x1876035258982016:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 183us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127232.210578:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000001:00080000:1.0:1789127232.210685:0:23449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1789127232.211565:0:23449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1789127232.211611:0:23449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1789127232.211700:0:23449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23449:1876035276906496:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789127232.211749:0:23449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127232.211776:0:23449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942017f9900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127232.211912:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276906496 00000100:00100000:3.0:1789127232.211918:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276906496 00000100:00100000:3.0:1789127232.211973:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789127232.211983:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23449:x1876035276906496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789127232.212071:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23449:x1876035276906496:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127232.212078:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789127232.212108:0:23449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23449:1876035276906496:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789127232.212229:0:23449:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1789127232.212262:0:23449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23449:1876035276906624:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789127232.212297:0:23449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127232.212318:0:23449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9942181069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127232.212348:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276906624 00000100:00100000:2.0:1789127232.212353:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276906624 00000100:00100000:2.0:1789127232.212386:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127232.212394:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104af9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23449:x1876035276906624:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789127232.212502:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104af9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:23449:x1876035276906624:12345-0@lo:1000:mdt00_002.0 Request processed in 109us (203us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1789127232.212510:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789127232.212591:0:23449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23449:1876035276906624:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789127232.212617:0:23449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212626:0:23449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212645:0:23449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212674:0:23449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127232.212679:0:23449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212688:0:23449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212702:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00010000:00010000:1.0:1789127232.212706:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127232.212710:0:23449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212717:0:23449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99422f9e2800/0xa840b4da666ecbe9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212744:0:23449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212751:0:23449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212757:0:23449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212761:0:23449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212167000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:1.0:1789127232.212764:0:23449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212779:0:23449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212788:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:1.0:1789127232.212790:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127232.212796:0:23449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ecb4f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca9a expref: 19 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212806:0:23449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ecb4f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca9a expref: 19 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212815:0:23449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ecb4f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca9a expref: 19 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.212861:0:23449:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff994212167400/0xa840b4da666ecb4f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1ca9a expref: 19 pid: 26359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127232.212872:0:23449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276906752:192.168.203.23@tcp:105: 00000100:00100000:1.0:1789127232.212929:0:23449:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127232.215532:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.215620:0:23449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488f840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23449:1876035276906752:192.168.203.23@tcp:105: 00000100:00100000:3.0:1789127232.215626:0:23450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258982144 00000100:00100000:3.0:1789127232.215635:0:23450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258982144 00010000:00010000:0.0:1789127232.215720:0:23449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215731:0:23449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212167000/0xa840b4da666ecb48 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127232.215751:0:23450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 10 00000100:00100000:3.0:1789127232.215764:0:23450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9942385af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+20:19023:x1876035258982144:12345-192.168.203.23@tcp:49:dd.0 00010000:00010000:0.0:1789127232.215764:0:23449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215783:0:23449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215811:0:23449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215821:0:23449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215827:0:23449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215834:0:23449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215840:0:23449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1a00 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127232.215844:0:23449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215851:0:23449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215862:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:0.0:1789127232.215866:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127232.215869:0:23449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215875:0:23449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1a00/0xa840b4da666ecbf0 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215886:0:23449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215892:0:23449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127232.215898:0:23450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9942385af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+20:19023:x1876035258982144:12345-192.168.203.23@tcp:49:dd.0 Request processed in 136us (373us total) trans 0 rc 0/0 00010000:00010000:0.0:1789127232.215909:0:23449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127232.215914:0:23450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 10 00010000:00010000:0.0:1789127232.215921:0:23449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99423cbe1000 already unused, calling callback (ffffffffc193f4f0) 00010000:00010000:0.0:1789127232.215925:0:23449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.215931:0:23449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.216351:0:23449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:0.0:1789127232.216355:0:23449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127232.216359:0:23449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.216366:0:23449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe1000/0xa840b4da666ecbe2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23449 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127232.216501:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104808b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce39c917-de43-41d2-aa7b-028f64ef55d1+19:19024:x1876035258981760:12345-192.168.203.23@tcp:57:lhsmtool_posix.0 Request processed in 14445us (14677us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1789127232.216511:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 63 00000020:00080000:0.0:1789127232.216514:0:23449:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789127232.216640:0:23484:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789127232.216681:0:23484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127232.216699:0:23484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789127232.216704:0:23484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789127232.218881:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127232.218962:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258982272 00000100:00100000:0.0:1789127232.218971:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258982272 00000100:00100000:0.0:1789127232.219028:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:0.0:1789127232.219039:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+19:19023:x1876035258982272:12345-192.168.203.23@tcp:101:dd.0 00010000:00010000:0.0:1789127232.219058:0:23448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127232.219083:0:23448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0600/0xa840b4da666ecbf7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa0a9d37d7f1cacb expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.219137:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbfe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.219150:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbfe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.219161:0:23448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbfe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23448 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.219266:0:23448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0600/0xa840b4da666ecbf7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cacb expref: 21 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.219284:0:23448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99423cbe0000/0xa840b4da666ecbfe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cacb expref: 20 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.219293:0:23448:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff994238d22900) 00010000:00010000:0.0:1789127232.219296:0:23448:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127232.219299:0:23448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99423cbe0000, rc 0) 00000100:00100000:0.0:1789127232.219358:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+20:19023:x1876035258982272:12345-192.168.203.23@tcp:101:dd.0 Request processed in 320us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127232.219366:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 64 00000100:00100000:1.0:1789127232.219691:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.219966:0:23450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258982528 00000100:00100000:3.0:1789127232.219971:0:23450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258982528 00000100:00100000:3.0:1789127232.220008:0:23450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 11 00000100:00100000:3.0:1789127232.220016:0:23450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+20:19024:x1876035258982528:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789127232.220234:0:23450:0:(mdd_object.c:4024:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789127232.220264:0:23450:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1789127232.220290:0:23450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.220302:0:23450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.220311:0:23450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.220317:0:23450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.220336:0:23450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.220343:0:23450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.220361:0:23450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127232.220395:0:25263:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127232.220404:0:25263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.220412:0:25263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994212166000 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:2.0:1789127232.220416:0:25263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.220425:0:25263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.220439:0:25263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff994103ea6a00) 00000100:00100000:3.0:1789127232.220440:0:23450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+22:19024:x1876035258982528:12345-192.168.203.23@tcp:35:lhsmtool_posix.0 Request processed in 421us (746us total) trans 12884901918 rc 0/0 00010000:00010000:2.0:1789127232.220445:0:25263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1789127232.220452:0:23450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 11 00010000:00010000:2.0:1789127232.220452:0:25263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789127232.220460:0:23450:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789127232.220463:0:25263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994212166000/0xa840b4da666ecc05 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23450 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.220476:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127232.220477:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127232.220478:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127232.241580:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127232.242144:0:24963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258982656 00000100:00100000:1.0:1789127232.242153:0:24963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258982656 00000100:00100000:1.0:1789127232.242272:0:24963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 0 00000100:00100000:1.0:1789127232.242284:0:24963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+8:2394:x1876035258982656:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:1.0:1789127232.242318:0:24963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.242351:0:24963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cac4 expref: 8 pid: 25262 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.242359:0:24963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127232.242364:0:24963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127232.242380:0:24963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.242414:0:24963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cac4 expref: 8 pid: 25262 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.242428:0:24963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cac4 expref: 8 pid: 25262 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127232.242442:0:24963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24963:1876035276906880:192.168.203.23@tcp:104: 00000100:00100000:1.0:1789127232.242535:0:24963:0:(client.c:2715:ptlrpc_set_wait()) set ffff994218106480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127232.243328:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:1.0:1789127232.249121:0:24965:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789127232.249141:0:24965:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789127232.249369:0:24964:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789127232.249395:0:24964:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258982784 00000100:00100000:0.0:1789127232.249405:0:24964:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258982784 00000100:00100000:1.0:1789127232.250129:0:24963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488d680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24963:1876035276906880:192.168.203.23@tcp:104: 00010000:00010000:1.0:1789127232.250155:0:24963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127232.251932:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127232.252130:0:24204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258982912 00000100:00100000:3.0:1789127232.252138:0:24204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258982912 00010000:00010000:3.0:1789127232.252177:0:24204:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cac4 expref: 10 pid: 25262 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127232.252256:0:24204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:3.0:1789127232.252267:0:24204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410488d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+10:2393:x1876035258982912:12345-192.168.203.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127232.252286:0:24204:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127232.252306:0:24204:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cac4 expref: 10 pid: 25262 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.252320:0:24204:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cac4 expref: 10 pid: 25262 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.252342:0:24204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076216712/0xa840b4da666ecbcd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.23@tcp remote: 0xa0a9d37d7f1cac4 expref: 10 pid: 25262 timeout: 757 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.252376:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127232.252380:0:24204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127232.252387:0:24204:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.252398:0:24204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.252425:0:24204:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127232.252485:0:24204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410488d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+9:2393:x1876035258982912:12345-192.168.203.23@tcp:103:ldlm_bl.0 Request processed in 219us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127232.252493:0:24204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00010000:00010000:1.0:1789127232.252597:0:24963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.252618:0:24963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127232.253572:0:26502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 1 00000100:00100000:2.0:1789127232.253584:0:26502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+8:2394:x1876035258982784:12345-192.168.203.23@tcp:4:dd.0 00010000:00010000:2.0:1789127232.253616:0:26502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.253641:0:26502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127232.253645:0:26502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127232.253664:0:26502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127232.253793:0:26502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127232.318435:0:24954:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1789127232.318452:0:24954:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:1.0:1789127232.318831:0:24963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1789127232.318837:0:24963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1789127230 -> 1789127231 00002000:00010000:1.0:1789127232.318840:0:24963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789127230 -> 1789127231 00002000:00010000:1.0:1789127232.318842:0:24963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1789127232.318860:0:24963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.318873:0:24963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.318881:0:24963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.318889:0:24963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99422f9e2800 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:1.0:1789127232.318893:0:24963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.318902:0:24963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.319737:0:24963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.319767:0:24963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000282e1300/0xa840b4da666ecc0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127232.319908:0:24963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ce39c917-de43-41d2-aa7b-028f64ef55d1+7:2394:x1876035258982656:12345-192.168.203.23@tcp:4:dd.0 Request processed in 77621us (78331us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789127232.319927:0:24963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 0 00000001:00080000:3.0:1789127232.351445:0:24954:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:0.0:1789127232.351787:0:26502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1789127232.351793:0:26502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1789127232.351817:0:26502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.351844:0:26502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.351853:0:26502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.351860:0:26502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994236589c00 already unused, calling callback (ffffffffc0cfc550) 00010000:00010000:0.0:1789127232.351865:0:26502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.351874:0:26502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.351899:0:26502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.351906:0:26502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e285f72e/0xa840b4da666ecc13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127232.352201:0:26502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104018b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2394:x1876035258982784:12345-192.168.203.23@tcp:4:dd.0 Request processed in 98615us (108869us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789127232.352212:0:26502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 1 00010000:00010000:2.0:1789127232.682831:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127232.683556:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276907008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127232.683626:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127232.683796:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276907008 00000100:00100000:2.0:1789127232.683812:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276907008 00000100:00100000:2.0:1789127232.683880:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127232.683890:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276907008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127232.683922:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915853824 avail 3676626944 00000100:00080000:0.0:1789127232.684191:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127232.684522:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9941040192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876035276907008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 632us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127232.684531:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127232.684620:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1876035276907008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127233.706913:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127233.706946:0:3642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276907136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127233.707015:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127233.707067:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276907136 00000100:00100000:2.0:1789127233.707074:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276907136 00000100:00100000:2.0:1789127233.707137:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127233.707146:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276907136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127233.707183:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127233.707225:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994104809680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1876035276907136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127233.707251:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1789127233.707312:0:23435:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127233.707341:0:3642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1876035276907136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127233.708051:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127233.708065:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99423cba0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276907264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127233.708106:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127233.708284:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276907264 00000100:00100000:0.0:1789127233.708289:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276907264 00000100:00100000:0.0:1789127233.708329:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127233.708347:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276907264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127233.708370:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1789127233.708420:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410401b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276907264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127233.708426:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789127233.708531:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99423cba0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276907264:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1789127233.896027:0:26539:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789127234.730966:0:25263:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127234.734482:0:24206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127235.409635:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127235.409706:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127235.409735:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127235.409770:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127235.409788:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127235.409806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127235.409827:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127235.409848:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:0.0:1789127235.409872:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.23@tcp (source: 12345-192.168.203.23@tcp) 00000100:00100000:3.0:1789127235.409874:0:23441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258983040 00000100:00100000:3.0:1789127235.409888:0:23441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258983040 00000100:00100000:0.0:1789127235.409892:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258983552 00000100:00100000:0.0:1789127235.409895:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258983552 00000100:00100000:0.0:1789127235.409953:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258984064 00000100:00100000:0.0:1789127235.409956:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258984064 00000100:00100000:3.0:1789127235.409963:0:23441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:0.0:1789127235.409970:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258983424 00000100:00100000:0.0:1789127235.409972:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258983424 00000100:00100000:3.0:1789127235.409974:0:23441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:2392:x1876035258983040:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127235.409984:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258983936 00000100:00100000:0.0:1789127235.409987:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258983936 00000100:00100000:0.0:1789127235.410015:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1789127235.410021:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2392:x1876035258983552:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:2.0:1789127235.410093:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258983296 00000100:00100000:2.0:1789127235.410098:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258983296 00000100:00100000:2.0:1789127235.410134:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258983808 00000100:00100000:2.0:1789127235.410137:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258983808 00000100:00100000:2.0:1789127235.410152:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258983168 00000100:00100000:2.0:1789127235.410154:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258983168 00000100:00100000:2.0:1789127235.410167:0:26359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035258983680 00000100:00100000:2.0:1789127235.410169:0:26359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035258983680 00000100:00100000:2.0:1789127235.410185:0:26359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:2.0:1789127235.410192:0:26359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2392:x1876035258983296:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127235.410267:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2392:x1876035258983552:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 244us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.410275:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 20 00000100:00100000:0.0:1789127235.410296:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1789127235.410311:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2392:x1876035258984064:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127235.412516:0:23441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd0d2d92-1b72-4ea8-8c54-6f5fa0938b2a+13:2392:x1876035258983040:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 2530us (2883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.412532:0:23441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 163 00000100:00100000:3.0:1789127235.412619:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:3.0:1789127235.412634:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2392:x1876035258983808:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127235.412701:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2392:x1876035258983808:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 74us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.412708:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 54 00000100:00100000:3.0:1789127235.412727:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1789127235.412734:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+22:2392:x1876035258983168:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127235.412764:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce39c917-de43-41d2-aa7b-028f64ef55d1+22:2392:x1876035258983168:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 32us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.412770:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 55 00000100:00100000:3.0:1789127235.412782:0:24979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:3.0:1789127235.412789:0:24979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:2392:x1876035258983680:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:3.0:1789127235.412819:0:24979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:20e4c89f-9d0f-4fa6-a881-4560a0c09634+6:2392:x1876035258983680:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 30us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.412825:0:24979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 56 00000100:00100000:2.0:1789127235.415673:0:26359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2392:x1876035258983296:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 5441us (5926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.415690:0:26359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 53 00000100:00100000:0.0:1789127235.417570:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2392:x1876035258984064:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 7245us (7765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.417588:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 21 00000100:00100000:0.0:1789127235.417630:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1789127235.417663:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2392:x1876035258983424:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127235.417724:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce39c917-de43-41d2-aa7b-028f64ef55d1+5:2392:x1876035258983424:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 84us (7895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.417732:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 22 00000100:00100000:0.0:1789127235.417814:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00100000:0.0:1789127235.417824:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99423cba0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2392:x1876035258983936:12345-192.168.203.23@tcp:400:kworker.0 00000100:00100000:0.0:1789127235.417884:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99423cba0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:20e4c89f-9d0f-4fa6-a881-4560a0c09634+5:2392:x1876035258983936:12345-192.168.203.23@tcp:400:kworker.0 Request processed in 62us (8010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.417892:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.23@tcp, seq: 23 00000100:00080000:0.0:1789127235.418132:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127235.418139:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127235.418143:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127235.418146:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789127235.756239:0:23436:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127235.756480:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276907392:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.756552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.756591:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276907904:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.756617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.756635:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276908416:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.756685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.756701:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276908928:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.756718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.756743:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789127235.756748:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276907520:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.756770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.756788:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276908032:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.756811:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.756827:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276908544:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.756847:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.756874:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276907648:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.756908:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.758663:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d37c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276908160:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.758712:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.758741:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276908672:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.758767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.758790:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789127235.758797:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276907776:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.758817:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.758834:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276908288:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.758852:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.758868:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994101d370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276908800:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.758887:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.758940:0:23439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276907392 00000100:00100000:2.0:1789127235.759337:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276909184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127235.759368:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127235.759775:0:24959:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276907648 00000100:00100000:2.0:1789127235.759783:0:24959:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276907648 00000100:00100000:3.0:1789127235.759845:0:23439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276907392 00000100:00100000:3.0:1789127235.759894:0:23439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789127235.759902:0:23439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3639:x1876035276907392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.759976:0:23439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99422fa94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8bdd08e-30e7-43f1-a5d6-15b6369dde73+24:3639:x1876035276907392:12345-0@lo:400:kworker.0 Request processed in 74us (3423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.759983:0:23439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789127235.760104:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276908160 00000100:00100000:3.0:1789127235.760108:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276908160 00000100:00100000:1.0:1789127235.760175:0:24961:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276909184 00000100:00100000:1.0:1789127235.760179:0:24961:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276909184 00000100:00100000:2.0:1789127235.764629:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276907904 00000100:00100000:2.0:1789127235.764641:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276907904 00000100:00100000:2.0:1789127235.764749:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276908416 00000100:00100000:2.0:1789127235.764753:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276908416 00000100:00100000:2.0:1789127235.764765:0:23449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276908928 00000100:00100000:2.0:1789127235.764767:0:23449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276908928 00000100:00100000:3.0:1789127235.764967:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276907776 00000100:00100000:3.0:1789127235.764971:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276907776 00000100:00100000:3.0:1789127235.764988:0:24958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276908288 00000100:00100000:3.0:1789127235.764991:0:24958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276908288 00000100:00100000:3.0:1789127235.765021:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127235.765030:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276908160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765122:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276908160:12345-0@lo:400:kworker.0 Request processed in 92us (6408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.765129:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127235.765155:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127235.765163:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276907776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765195:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276907776:12345-0@lo:400:kworker.0 Request processed in 34us (6377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.765202:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127235.765213:0:24958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127235.765220:0:24958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876035276908288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765245:0:24958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1876035276908288:12345-0@lo:400:kworker.0 Request processed in 27us (6392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.765251:0:24958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127235.765274:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276908544 00000100:00100000:3.0:1789127235.765278:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276908544 00000100:00100000:3.0:1789127235.765293:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276908672 00000100:00100000:3.0:1789127235.765295:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276908672 00000100:00100000:3.0:1789127235.765304:0:23448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276908800 00000100:00100000:3.0:1789127235.765305:0:23448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276908800 00000100:00100000:3.0:1789127235.765315:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789127235.765321:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276907904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765353:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876035276907904:12345-0@lo:400:kworker.0 Request processed in 32us (8734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.765359:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789127235.765370:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789127235.765376:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276908416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765402:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876035276908416:12345-0@lo:400:kworker.0 Request processed in 26us (8716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.765408:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789127235.765418:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789127235.765423:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276908544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765446:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876035276908544:12345-0@lo:400:kworker.0 Request processed in 24us (8599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.765452:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789127235.765462:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789127235.765467:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276908672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765491:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876035276908672:12345-0@lo:400:kworker.0 Request processed in 24us (6723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.765496:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789127235.765505:0:23448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789127235.765516:0:23448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276908800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765541:0:23448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876035276908800:12345-0@lo:400:kworker.0 Request processed in 26us (6652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.765546:0:23448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789127235.765576:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276909056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127235.765612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127235.765686:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1876035276908544:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765698:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8bdd08e-30e7-43f1-a5d6-15b6369dde73:3639:1876035276907392:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765707:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876035276907904:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765716:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876035276908416:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765753:0:24962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276909056 00000100:00100000:3.0:1789127235.765756:0:24962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276909056 00000100:00100000:3.0:1789127235.765774:0:24962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127235.765780:0:24962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276909056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127235.765800:0:24962:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127235.765833:0:24962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876035276909056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.765839:0:24962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127235.765868:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994104808f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1876035276909056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127235.765889:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d36580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276907776:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765899:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d343c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276908288:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765908:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1876035276908800:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.765949:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d37c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276908160:0@lo:400:kworker.0 00010000:00080000:3.0:1789127235.765962:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994101d35680 x1876035276908672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127235.765974:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d35680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1876035276908672:0@lo:400:kworker.0 00000100:00100000:1.0:1789127235.766738:0:24961:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127235.766746:0:24961:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276909184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127235.766761:0:24961:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789127235.766812:0:24961:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99410480b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876035276909184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (7443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127235.766819:0:24961:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127235.766857:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99410488cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1876035276909184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127235.767250:0:23449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127235.767259:0:23449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276908928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127235.767309:0:23449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876035276908928:12345-0@lo:400:kworker.0 Request processed in 51us (10589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.767316:0:23449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789127235.767363:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127235.767368:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127235.767371:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127235.767373:0:23443:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789127235.767529:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff994101d352c0 x1876035276908928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127235.767541:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1876035276908928:0@lo:400:kworker.0 00000100:00100000:2.0:1789127235.767609:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276907520 00000100:00100000:2.0:1789127235.767615:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276907520 00000100:00100000:2.0:1789127235.767635:0:23453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035276908032 00000100:00100000:2.0:1789127235.767638:0:23453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035276908032 00000100:00100000:0.0:1789127235.767849:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127235.767857:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276907520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127235.767908:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876035276907520:12345-0@lo:400:kworker.0 Request processed in 53us (11137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.767934:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127235.767999:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994219ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1876035276907520:0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.768326:0:24959:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127235.768335:0:24959:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276907648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127235.768375:0:24959:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876035276907648:12345-0@lo:400:kworker.0 Request processed in 43us (11466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127235.768382:0:24959:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789127235.769195:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1789127235.769203:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99422fa4d680, transno 12884901892 00000004:00080000:1.0:1789127235.769218:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1789127235.769236:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1876035276907648:0@lo:400:kworker.0 00000100:00100000:2.0:1789127235.775665:0:23453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789127235.775687:0:23453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994101d361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276908032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127235.775789:0:23453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994101d361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876035276908032:12345-0@lo:400:kworker.0 Request processed in 113us (18977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.775796:0:23453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789127235.775896:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994101d34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1876035276908032:0@lo:400:kworker.0 Debug log: 14011 lines, 14011 kept, 0 dropped, 0 bad.