00000001:00080000:0.0F:1715209108.453625:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967491 is committed 00010000:00010000:2.0F:1715209108.453696:0:3669:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520900/0xfa8b5bed87892a6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x953bb9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453712:0:3669:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520900/0xfa8b5bed87892a6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x953bb9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453718:0:3669:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520900/0xfa8b5bed87892a6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x953bb9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453722:0:3669:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d520900 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715209108.453725:0:3669:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520900/0xfa8b5bed87892a6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x953bb9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453730:0:3669:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520900/0xfa8b5bed87892a6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x953bb9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453766:0:3669:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x953bb9f6 (ffff88012e8ee000) 00010000:00010000:2.0:1715209108.453769:0:3669:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715209108.453773:0:3669:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520900/0xfa8b5bed87892a6f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x953bb9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453780:0:3669:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d520900/0xfa8b5bed87892a6f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x953bb9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453823:0:3669:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523cc0/0xfa8b5bed87892a76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453829:0:3669:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523cc0/0xfa8b5bed87892a76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453835:0:3669:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523cc0/0xfa8b5bed87892a76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453841:0:3669:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d523cc0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715209108.453844:0:3669:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523cc0/0xfa8b5bed87892a76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453856:0:3669:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523cc0/0xfa8b5bed87892a76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453865:0:3669:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x0 (ffff88012e8eeb00) 00010000:00010000:2.0:1715209108.453867:0:3669:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715209108.453870:0:3669:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523cc0/0xfa8b5bed87892a76 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453875:0:3669:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523cc0/0xfa8b5bed87892a76 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453922:0:3669:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521b00/0xfa8b5bed87892adf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x953bba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453928:0:3669:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521b00/0xfa8b5bed87892adf lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x953bba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453933:0:3669:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521b00/0xfa8b5bed87892adf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x953bba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453939:0:3669:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012d521b00 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715209108.453942:0:3669:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521b00/0xfa8b5bed87892adf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x953bba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453947:0:3669:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521b00/0xfa8b5bed87892adf lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x11:0x0].0x953bba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453954:0:3669:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x11:0x0].0x953bba08 (ffff88012e8ee300) 00010000:00010000:2.0:1715209108.453956:0:3669:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715209108.453958:0:3669:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521b00/0xfa8b5bed87892adf lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x953bba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:2.0:1715209108.453964:0:3669:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521b00/0xfa8b5bed87892adf lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x11:0x0].0x953bba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:3.0F:1715209108.458114:0:7113:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1715209108.836086:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c11d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3686:1798523510939072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715209108.836117:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24597633-7c6c-43cc-a7e8-ad821c1018c0:3683:1798523510938880:0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.836182:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3684:1798523510938944:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836192:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209108.836192:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209108.836223:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3683:1798523510939136:0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836233:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3686:1798523510939328:0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.836240:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209108.836265:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510938880 00000100:00100000:1.0:1715209108.836265:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510938944 00000100:00100000:3.0:1715209108.836272:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510938880 00000100:00100000:1.0:1715209108.836272:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510938944 00000100:00100000:0.0:1715209108.836282:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510939200:0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836309:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6228 00000100:00100000:3.0:1715209108.836310:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:1.0:1715209108.836316:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3684:x1798523510938944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836317:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3683:x1798523510938880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.836320:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715209108.836342:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510939456:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836361:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3683:x1798523510938880:12345-0@lo:400:kworker.0 Request processed in 43us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209108.836361:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3684:x1798523510938944:12345-0@lo:400:kworker.0 Request processed in 45us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.836369:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:1.0:1715209108.836370:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6228 00000100:00100000:0.0:1715209108.836377:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209108.836392:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715209108.836399:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801247db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510939712:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836400:0:9389:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939072 00000100:00100000:3.0:1715209108.836403:0:9389:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939072 00000100:00100000:1.0:1715209108.836405:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801247db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3686:1798523510939584:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836423:0:9389:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:1.0:1715209108.836426:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715209108.836426:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209108.836428:0:9389:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c11df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1798523510939072:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715209108.836442:0:3686:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1715209108.836447:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510939008:0@lo:400:kworker.0 00002000:00000024:3.0:1715209108.836451:0:9389:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 52903616 pending 0 free 3916210176 avail 3684687872 00000100:00100000:1.0:1715209108.836464:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715209108.836472:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3684:1798523510938944:0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836478:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3686:1798523510939264:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836480:0:9389:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c11df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3686:x1798523510939072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.836486:0:9389:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000100:00100000:0.0:1715209108.836488:0:3684:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715209108.836494:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715209108.836499:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801247d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523510939648:0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836505:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3686:1798523510939520:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836507:0:7127:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939200 00000100:00100000:3.0:1715209108.836510:0:7127:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939200 00000100:00100000:1.0:1715209108.836524:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209108.836527:0:7127:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939008 00000100:00100000:3.0:1715209108.836530:0:7127:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939008 00000100:00100000:0.0:1715209108.836530:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209108.836542:0:7127:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:3.0:1715209108.836546:0:7127:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510939200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836552:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c11d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3686:1798523510939072:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1715209108.836566:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715209078 00000100:00100000:1.0:1715209108.836573:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939328 00000100:00080000:0.0:1715209108.836573:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715209078 00000100:00100000:1.0:1715209108.836576:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939328 00000100:00100000:3.0:1715209108.836577:0:7127:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510939200:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.836583:0:7127:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00000100:00100000:0.0:1715209108.836598:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:1.0:1715209108.836599:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939584 00000100:00100000:1.0:1715209108.836601:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939584 00000100:00100000:0.0:1715209108.836609:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3686:x1798523510939008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836614:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939264 00000100:00100000:3.0:1715209108.836616:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209108.836616:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939264 00000100:00100000:3.0:1715209108.836629:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009ef89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510939392:0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836638:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939520 00000100:00100000:1.0:1715209108.836641:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939520 00000100:00100000:1.0:1715209108.836649:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939136 00000100:00100000:1.0:1715209108.836651:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939136 00000100:00100000:3.0:1715209108.836654:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209108.836662:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6229 00000100:00100000:1.0:1715209108.836667:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1798523510939328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.836668:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3686:x1798523510939008:12345-0@lo:400:kworker.0 Request processed in 59us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.836679:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24597633-7c6c-43cc-a7e8-ad821c1018c0:3683:1798523510938880:0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.836680:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:1.0:1715209108.836699:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1798523510939328:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.836704:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6230 00000100:00100000:1.0:1715209108.836708:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6229 00000100:00100000:3.0:1715209108.836709:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1798523510939584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.836713:0:9918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939456 00000100:00100000:0.0:1715209108.836720:0:9918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939456 00000100:00100000:1.0:1715209108.836721:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6231 00000100:00100000:1.0:1715209108.836725:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1798523510939264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836737:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1798523510939584:12345-0@lo:400:kworker.0 Request processed in 28us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.836744:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6230 00000100:00100000:1.0:1715209108.836745:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1798523510939264:12345-0@lo:400:kworker.0 Request processed in 18us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209108.836751:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6231 00000100:00100000:0.0:1715209108.836752:0:9918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939712 00000100:00100000:0.0:1715209108.836756:0:9918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939712 00000100:00100000:3.0:1715209108.836760:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6232 00000100:00100000:3.0:1715209108.836765:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1798523510939520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836765:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6233 00000100:00100000:1.0:1715209108.836769:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d8bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3683:x1798523510939136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.836777:0:9918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939648 00000100:00100000:0.0:1715209108.836780:0:9918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939648 00000100:00100000:3.0:1715209108.836788:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1798523510939520:12345-0@lo:400:kworker.0 Request processed in 23us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.836793:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6232 00000100:00100000:1.0:1715209108.836797:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d8bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3683:x1798523510939136:12345-0@lo:400:kworker.0 Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209108.836800:0:9918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939392 00000100:00100000:1.0:1715209108.836803:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6233 00000100:00100000:0.0:1715209108.836803:0:9918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939392 00000100:00100000:3.0:1715209108.836813:0:9387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:3.0:1715209108.836817:0:9387:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510939456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836837:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ef88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510939008:0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.836841:0:9918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369 00000100:00100000:1.0:1715209108.836847:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ef8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3686:1798523510939264:0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.836850:0:9918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510939712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836855:0:9387:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510939456:12345-0@lo:400:kworker.0 Request processed in 36us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209108.836858:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ef8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3686:1798523510939520:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836861:0:9387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00000100:00100000:1.0:1715209108.836866:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ef8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3686:1798523510939328:0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.836876:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801247db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3686:1798523510939584:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836902:0:9387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:3.0:1715209108.836908:0:9387:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3684:x1798523510939648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.836938:0:9387:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3684:x1798523510939648:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209108.836943:0:9918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510939712:12345-0@lo:400:kworker.0 Request processed in 91us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.836944:0:9387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00000100:00100000:0.0:1715209108.836955:0:9918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369 00000100:00100000:3.0:1715209108.836966:0:9387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371 00000100:00100000:3.0:1715209108.836979:0:9387:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3683:x1798523510939392:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1715209108.836989:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715209078 00000100:00080000:0.0:1715209108.836993:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715209078 00000100:00080000:0.0:1715209108.836997:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715209078 00000100:00080000:0.0:1715209108.837000:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715209078 00000100:00100000:3.0:1715209108.837006:0:9387:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3683:x1798523510939392:12345-0@lo:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.837012:0:9387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371 00000100:00100000:0.0:1715209108.837033:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801247d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523510939648:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.837041:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ef88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3683:1798523510939136:0@lo:400:kworker.0 00000100:00100000:3.0:1715209108.837050:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ef89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510939392:0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.837051:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ef89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510939200:0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.837067:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009ef8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510939456:0@lo:400:kworker.0 00000100:00100000:0.0:1715209108.837080:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801247db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510939712:0@lo:400:kworker.0 00000100:00100000:1.0:1715209108.852007:0:3686:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715209108.852021:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510939776:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1715209108.852057:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209108.852190:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939776 00000100:00100000:3.0:1715209108.852198:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939776 00000100:00100000:3.0:1715209108.852242:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:3.0:1715209108.852250:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f88f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523510939776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715209108.852269:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 52903616 pending 0 free 3916210176 avail 3684687872 00000100:00100000:3.0:1715209108.852322:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f88f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523510939776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.852329:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:1.0:1715209108.852369:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510939776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715209108.857749:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209108.857866:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505139904 00000100:00100000:2.0:1715209108.857902:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505139904 00000100:00100000:2.0:1715209108.857962:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 570 00000100:00080000:0.0:1715209108.857965:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715209078 00000100:00100000:2.0:1715209108.857970:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+38:30337:x1798523505139904:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715209108.858057:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d954e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+38:30337:x1798523505139904:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209108.858066:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 570 00000100:00100000:2.0:1715209108.859477:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209108.859606:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505139968 00000100:00100000:3.0:1715209108.859615:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505139968 00000100:00100000:3.0:1715209108.859671:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 571 00000100:00100000:3.0:1715209108.859679:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+22:30337:x1798523505139968:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1715209108.859727:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715209078 00000100:00100000:3.0:1715209108.859740:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+22:30337:x1798523505139968:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 61us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209108.859748:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 571 00000100:00100000:2.0:1715209108.861245:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209108.861276:0:15069:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505140096 00000100:00100000:2.0:1715209108.861282:0:15069:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505140096 00000100:00100000:2.0:1715209108.861309:0:15069:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 95 00000100:00100000:2.0:1715209108.861317:0:15069:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+38:30337:x1798523505140096:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715209108.861489:0:15069:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+39:30337:x1798523505140096:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 171us (247us total) trans 4294967492 rc 0/0 00000100:00100000:2.0:1715209108.861498:0:15069:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 95 00010000:00010000:2.0:1715209109.460159:0:14811:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715209110.116041:0:3685:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1715209110.116062:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510939840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715209110.116151:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209110.116181:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939840 00000100:00100000:1.0:1715209110.116193:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939840 00000100:00100000:1.0:1715209110.116250:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1715209110.116256:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523510939840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1715209110.116292:0:7128:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444990976 avail 1315528704 00000100:00100000:1.0:1715209110.116354:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523510939840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209110.116363:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:0.0:1715209110.116397:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510939840:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1715209110.462057:0:9401:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715209110.714255:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715209110.714296:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209110.714315:0:7119:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505140160 00000100:00100000:0.0:1715209110.714316:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209110.714328:0:7119:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505140160 00000100:00100000:0.0:1715209110.714334:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209110.714357:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505140224 00000100:00100000:3.0:1715209110.714366:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505140224 00000100:00100000:0.0:1715209110.714371:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715209110.714396:0:9387:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505140416 00000100:00100000:2.0:1715209110.714398:0:7119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1885 00000100:00100000:3.0:1715209110.714406:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505140288 00000100:00100000:2.0:1715209110.714406:0:7119:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2003:x1798523505140160:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1715209110.714408:0:9387:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505140416 00000100:00100000:3.0:1715209110.714409:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505140288 00000100:00100000:1.0:1715209110.714412:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505140352 00000100:00100000:1.0:1715209110.714422:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505140352 00000100:00100000:3.0:1715209110.714428:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6234 00000100:00100000:0.0:1715209110.714441:0:9387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3372 00000100:00100000:3.0:1715209110.714445:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2002:x1798523505140224:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1715209110.714448:0:9387:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:2003:x1798523505140416:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1715209110.714462:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6235 00000100:00100000:2.0:1715209110.714473:0:7119:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2003:x1798523505140160:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209110.714473:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+39:2003:x1798523505140288:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1715209110.714482:0:7119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1885 00000100:00100000:0.0:1715209110.714490:0:9387:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:2003:x1798523505140416:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 43us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209110.714498:0:9387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3372 00000100:00100000:3.0:1715209110.714505:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2002:x1798523505140224:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209110.714513:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6234 00000100:00100000:1.0:1715209110.714523:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+39:2003:x1798523505140288:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209110.714531:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6236 00000100:00100000:2.0:1715209110.714536:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+22:2002:x1798523505140352:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1715209110.714549:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6235 00000100:00100000:2.0:1715209110.714565:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+22:2002:x1798523505140352:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 29us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209110.714572:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6236 00000100:00080000:1.0:1715209110.714579:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715209080 00000100:00080000:1.0:1715209110.714584:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715209080 00000100:00080000:1.0:1715209110.714587:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715209080 00000100:00080000:1.0:1715209110.714590:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715209080 00010000:00010000:2.0:1715209111.464057:0:7112:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715209111.689948:0:1259:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 27a: Remove the archive of an imported file (Operation not permitted) ========================================================== 18:58:31 (1715209111) 00000100:00100000:0.0:1715209111.803149:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209111.803297:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505140608 00000100:00100000:2.0:1715209111.803311:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505140608 00000100:00100000:2.0:1715209111.803378:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 572 00000100:00100000:2.0:1715209111.803388:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+39:31610:x1798523505140608:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715209111.803410:0:7123:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715209111.803430:0:7123:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9680/0xfa8b5bed87892af4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd5570806 expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209111.803507:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803523:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803536:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803549:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803556:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803562:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00000004:00200000:2.0:1715209111.803645:0:7123:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1715209111.803715:0:7123:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803723:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803729:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803736:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803742:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ded9b00 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715209111.803746:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803753:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803765:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8801303a6000) 00010000:00010000:2.0:1715209111.803768:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715209111.803772:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803778:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9b00/0xfa8b5bed87892afb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803810:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803816:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803834:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803839:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009ded98c0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715209111.803842:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803847:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803855:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff88009eedaf00) 00010000:00010000:2.0:1715209111.803857:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715209111.803860:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803865:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded98c0/0xfa8b5bed87892b02 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715209111.803946:0:7123:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9680/0xfa8b5bed87892af4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd5570806 expref: 41 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209111.803956:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ded9680/0xfa8b5bed87892af4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd5570806 expref: 41 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209111.803965:0:7123:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ded9680, rc 0) 00000100:00100000:2.0:1715209111.804026:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+40:31610:x1798523505140608:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 639us (887us total) trans 4294967493 rc 301/301 00000100:00100000:2.0:1715209111.804036:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 572 00000100:00100000:0.0:1715209111.805938:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209111.806025:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505140672 00000100:00100000:2.0:1715209111.806034:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505140672 00000100:00100000:2.0:1715209111.806113:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 573 00000100:00100000:2.0:1715209111.806122:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+40:31610:x1798523505140672:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715209111.806199:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+40:31610:x1798523505140672:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209111.806207:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 573 00000100:00100000:0.0:1715209111.807468:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209111.807584:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505140736 00000100:00100000:2.0:1715209111.807593:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505140736 00000100:00100000:2.0:1715209111.807640:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 574 00000100:00100000:2.0:1715209111.807647:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+22:31610:x1798523505140736:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715209111.807718:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+22:31610:x1798523505140736:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209111.807727:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 574 00000100:00100000:2.0:1715209111.988222:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510939968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715209111.988237:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510939904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715209111.988308:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715209111.988308:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209111.988372:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939968 00000100:00100000:3.0:1715209111.988383:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939968 00000100:00100000:1.0:1715209111.988393:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510939904 00000100:00100000:1.0:1715209111.988404:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510939904 00000100:00100000:3.0:1715209111.988437:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00080000:0.0:1715209111.988438:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715209081 00000100:00100000:3.0:1715209111.988446:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d9d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523510939968:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715209111.988466:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:1.0:1715209111.988476:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a02fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510939904:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:3.0:1715209111.988479:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000004:00000024:1.0:1715209111.988514:0:7128:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446277120 avail 1316814848 00000100:00100000:3.0:1715209111.988530:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d9d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523510939968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209111.988537:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:2.0:1715209111.988559:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f88d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510939968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715209111.988583:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a02fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510939904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209111.988592:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1715209111.988619:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d8b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510939904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715209112.004143:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a02f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510940032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715209112.004186:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209112.004304:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510940032 00000100:00100000:3.0:1715209112.004313:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510940032 00000100:00100000:3.0:1715209112.004369:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00080000:0.0:1715209112.004370:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715209082 00000100:00100000:3.0:1715209112.004376:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510940032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715209112.004394:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000100:00100000:3.0:1715209112.004445:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510940032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209112.004453:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:2.0:1715209112.004492:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a02f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510940032:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1715209112.466230:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1715209112.739995:0:15215:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715209112.740003:0:15215:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715209112.740578:0:15215:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715209112.740585:0:15215:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1715209112.776650:0:15218:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1715209112.785849:0:1324:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_27a: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d27a.sanity-hsm' Debug log: 348 lines, 348 kept, 0 dropped, 0 bad.