00010000:00010000:2.0F:1715208003.240074:0:7113:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715208003.348135:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510666496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715208003.348227:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1715208003.348295:0:7127:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510666496 00000100:00100000:0.0:1715208003.348314:0:7127:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510666496 00000100:00100000:0.0:1715208003.348368:0:7127:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1715208003.348377:0:7127:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3683:x1798523510666496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715208003.348415:0:7127:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445031936 avail 1315569664 00000100:00100000:0.0:1715208003.348470:0:7127:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3683:x1798523510666496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208003.348479:0:7127:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:2.0:1715208003.348505:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012ef8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510666496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715208003.745492:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208003.745608:0:21028:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505044864 00000100:00100000:2.0:1715208003.745621:0:21028:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505044864 00000100:00100000:2.0:1715208003.745705:0:21028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 398 00000100:00100000:2.0:1715208003.745715:0:21028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+24:3565:x1798523505044864:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0F:1715208003.745758:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207973 00000100:00100000:2.0:1715208003.745817:0:21028:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+24:3565:x1798523505044864:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 103us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208003.745826:0:21028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 398 00000100:00100000:0.0:1715208003.747859:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208003.747939:0:21028:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505044928 00000100:00100000:2.0:1715208003.747946:0:21028:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505044928 00000100:00080000:3.0:1715208003.747970:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207973 00000100:00100000:2.0:1715208003.747980:0:21028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 399 00000100:00100000:2.0:1715208003.747987:0:21028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:3565:x1798523505044928:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715208003.748068:0:21028:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:3565:x1798523505044928:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208003.748076:0:21028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 399 00000100:00100000:0.0:1715208003.749424:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208003.749550:0:7125:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505045056 00000100:00100000:2.0:1715208003.749559:0:7125:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505045056 00000100:00100000:2.0:1715208003.749608:0:7125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 68 00000100:00100000:2.0:1715208003.749616:0:7125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+24:3565:x1798523505045056:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715208003.749809:0:7125:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+25:3565:x1798523505045056:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 192us (388us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1715208003.749818:0:7125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 68 00010000:00010000:2.0:1715208004.241971:0:14811:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1715208004.468914:0:8254:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967338 is committed 00000020:00080000:0.0:1715208004.468930:0:8254:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88009e3ba600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1715208004.468935:0:8254:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8801300b4900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88009e3ba300 00000020:00080000:0.0:1715208004.468939:0:8254:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].5 00000020:00080000:0.0:1715208004.468942:0:8254:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff8801300b4500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009e0a4000 00000020:00080000:0.0:1715208004.468945:0:8254:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].5 00010000:00010000:1.0F:1715208004.469020:0:3670:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8800a8fded00/0xfa8b5bed878921fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21028 initiator: MDT1 00000020:00080000:2.0:1715208004.469070:0:8273:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 5 committed batchid 4 00010000:00010000:1.0:1715208004.469072:0:3670:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8800a8fded00/0xfa8b5bed878921fc lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469081:0:3670:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8800a8fded00/0xfa8b5bed878921fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469088:0:3670:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a8fded00 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715208004.469093:0:3670:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a8fded00/0xfa8b5bed878921fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469101:0:3670:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8800a8fded00/0xfa8b5bed878921fc lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469119:0:3670:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x0 (ffff8801300b4200) 00010000:00010000:1.0:1715208004.469123:0:3670:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1715208004.469124:0:8273:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 4 00010000:00010000:1.0:1715208004.469127:0:3670:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8800a8fded00/0xfa8b5bed878921fc lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469133:0:3670:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8800a8fded00/0xfa8b5bed878921fc lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469154:0:3670:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892273 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469161:0:3670:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892273 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469167:0:3670:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892273 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469172:0:3670:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4eac0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715208004.469174:0:3670:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892273 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469191:0:3670:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892273 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x7:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469199:0:3670:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x7:0x0].0x4d12f7d4 (ffff88012e8ee000) 00010000:00010000:1.0:1715208004.469201:0:3670:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715208004.469204:0:3670:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892273 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x7:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT1 00010000:00010000:1.0:1715208004.469209:0:3670:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892273 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x7:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT1 00000100:00100000:0.0:1715208004.473951:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715208004.473996:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715208004.474057:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208004.474087:0:21028:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505045184 00000100:00100000:0.0:1715208004.474091:0:9387:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505045248 00000100:00100000:2.0:1715208004.474100:0:21028:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505045184 00000100:00100000:0.0:1715208004.474100:0:9387:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505045248 00000100:00100000:1.0:1715208004.474113:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505045120 00000100:00100000:1.0:1715208004.474122:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505045120 00000100:00100000:0.0:1715208004.474143:0:9387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2279 00000100:00100000:0.0:1715208004.474153:0:9387:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+8:2003:x1798523505045248:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1715208004.474154:0:21028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4261 00000100:00100000:1.0:1715208004.474160:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1431 00000100:00100000:2.0:1715208004.474162:0:21028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2002:x1798523505045184:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1715208004.474168:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880075c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2003:x1798523505045120:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1715208004.474229:0:9387:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+8:2003:x1798523505045248:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 77us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208004.474233:0:21028:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2002:x1798523505045184:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208004.474238:0:9387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2279 00000100:00100000:1.0:1715208004.474241:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880075c80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2003:x1798523505045120:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208004.474242:0:21028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4261 00000100:00100000:1.0:1715208004.474249:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1431 00000100:00080000:0.0:1715208004.474266:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207974 00000100:00080000:0.0:1715208004.474271:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207974 00000100:00080000:0.0:1715208004.474273:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207974 00000100:00100000:2.0:1715208005.220065:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e1a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3685:1798523510666624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715208005.220068:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510666560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715208005.220143:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208005.220144:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208005.220166:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510666624 00000100:00100000:0.0:1715208005.220177:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510666624 00000100:00100000:2.0:1715208005.220200:0:7127:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510666560 00000100:00100000:2.0:1715208005.220205:0:7127:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510666560 00000100:00100000:2.0:1715208005.220233:0:7127:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:0.0:1715208005.220235:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:2.0:1715208005.220240:0:7127:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510666560:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715208005.220241:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3685:x1798523510666624:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:2.0:1715208005.220272:0:7127:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446297600 avail 1316835328 00002000:00000024:0.0:1715208005.220272:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000100:00080000:3.0:1715208005.220279:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207975 00000100:00100000:0.0:1715208005.220324:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e1a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3685:x1798523510666624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208005.220332:0:7127:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510666560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208005.220332:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:2.0:1715208005.220339:0:7127:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:3.0:1715208005.220359:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e1a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3685:1798523510666624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715208005.220359:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510666560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1715208005.236037:0:3685:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715208005.236051:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510666688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1715208005.236090:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208005.236113:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510666688 00000100:00100000:2.0:1715208005.236122:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510666688 00000100:00080000:3.0:1715208005.236144:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207975 00000100:00100000:2.0:1715208005.236153:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1715208005.236159:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510666688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1715208005.236175:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000100:00100000:2.0:1715208005.236229:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510666688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208005.236237:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:3.0:1715208005.236274:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510666688:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1715208005.244102:0:9401:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715208006.200607:0:30448:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 22: Could not swap a release file ===== 18:40:05 (1715208005) 00010000:00010000:3.0:1715208006.246022:0:7112:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715208006.251967:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208006.252048:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505045440 00000100:00100000:2.0:1715208006.252056:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505045440 00000100:00100000:2.0:1715208006.252104:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 400 00000100:00100000:2.0:1715208006.252110:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+25:5317:x1798523505045440:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715208006.252129:0:10664:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1715208006.252131:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207976 00010000:00010000:2.0:1715208006.252143:0:10664:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed87892288 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55702c6 expref: -99 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.252196:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252208:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252215:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252223:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252226:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252230:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00000004:00200000:2.0:1715208006.252276:0:10664:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1715208006.252322:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252326:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252337:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252341:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4c900 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.252343:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252348:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252356:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8801303a6000) 00010000:00010000:2.0:1715208006.252358:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.252360:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252363:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789228f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252379:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252382:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252384:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252387:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4d200 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.252388:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252391:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252399:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff88012e8ee000) 00010000:00010000:2.0:1715208006.252401:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.252402:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252405:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892296 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.252428:0:10664:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed87892288 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702c6 expref: 27 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.252432:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed87892288 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702c6 expref: 27 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.252437:0:10664:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4e880, rc 0) 00000100:00100000:2.0:1715208006.252477:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+26:5317:x1798523505045440:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 367us (514us total) trans 4294967437 rc 301/301 00000100:00100000:2.0:1715208006.252482:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 400 00000100:00100000:0.0:1715208006.253540:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208006.253610:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505045504 00000100:00100000:2.0:1715208006.253615:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505045504 00000100:00100000:2.0:1715208006.253639:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 401 00000100:00100000:2.0:1715208006.253643:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d2c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+26:5317:x1798523505045504:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715208006.253677:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d2c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+26:5317:x1798523505045504:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 34us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208006.253681:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 401 00000100:00100000:0.0:1715208006.254461:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715208006.254531:0:21028:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505045568 00000100:00100000:1.0:1715208006.254535:0:21028:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505045568 00000100:00100000:1.0:1715208006.254567:0:21028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 402 00000100:00100000:1.0:1715208006.254571:0:21028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+13:5317:x1798523505045568:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1715208006.254604:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207976 00000100:00100000:1.0:1715208006.254610:0:21028:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+13:5317:x1798523505045568:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208006.254614:0:21028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 402 00000100:00100000:0.0:1715208006.264432:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208006.264504:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505045888 00000100:00100000:2.0:1715208006.264509:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505045888 00000100:00100000:2.0:1715208006.264539:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 403 00000100:00100000:2.0:1715208006.264542:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+26:5322:x1798523505045888:12345-192.168.201.23@tcp:36:mkdir.0 00010000:00010000:2.0:1715208006.264563:0:10664:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715208006.264573:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed8789220a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd557028e expref: 26 pid: 21028 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.264587:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715208006.264589:0:10664:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715208006.264610:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264616:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264620:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264626:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878922ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264629:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878922ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264632:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878922ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264908:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c480/0xfa8b5bed878922b2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264913:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c480/0xfa8b5bed878922b2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264917:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c480/0xfa8b5bed878922b2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00000004:00010000:2.0:1715208006.264929:0:10664:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012ef8f800 reply state ffff8800a01de000 transno 4294967438 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c480/0xfa8b5bed878922b2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264934:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c480/0xfa8b5bed878922b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264938:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff88012e8ee700) 00010000:00010000:2.0:1715208006.264939:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715208006.264941:0:10664:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1715208006.264943:0:10664:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1715208006.264945:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264948:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264951:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264954:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4dd40 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.264956:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264959:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264962:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715208006.264963:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.264965:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264967:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00000004:00010000:2.0:1715208006.264977:0:10664:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012ef8f800 reply state ffff8800a01de000 transno 4294967438 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878922ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264981:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878922ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.264984:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbcd31978 (ffff88012e8eec00) 00010000:00010000:2.0:1715208006.264985:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715208006.264986:0:10664:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1715208006.265032:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+27:5322:x1798523505045888:12345-192.168.201.23@tcp:36:mkdir.0 Request processed in 488us (601us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1715208006.265036:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 403 00000100:00100000:0.0:1715208006.267913:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208006.267980:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505045952 00000100:00100000:2.0:1715208006.267984:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505045952 00000100:00100000:2.0:1715208006.268018:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 404 00000100:00100000:2.0:1715208006.268022:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+27:5323:x1798523505045952:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1715208006.268030:0:10664:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208006.268037:0:10664:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d8c0/0xfa8b5bed878922b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55702e2 expref: -99 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.268059:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4cb40/0xfa8b5bed878922c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.268065:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4cb40/0xfa8b5bed878922c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.268069:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4cb40/0xfa8b5bed878922c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00000004:00200000:2.0:1715208006.268082:0:10664:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1715208006.268089:0:10664:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715208006.268097:0:10664:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4cb40/0xfa8b5bed878922c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.268107:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d8c0/0xfa8b5bed878922b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702e2 expref: 29 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.268115:0:10664:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4cb40/0xfa8b5bed878922c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702e2 expref: 28 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.268119:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715208006.268121:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715208006.268123:0:10664:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4cb40, rc 0) 00000100:00100000:2.0:1715208006.268149:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+28:5323:x1798523505045952:12345-192.168.201.23@tcp:101:rm.0 Request processed in 126us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208006.268153:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 404 00000100:00100000:0.0:1715208006.269037:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208006.269103:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505046016 00000100:00100000:2.0:1715208006.269108:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505046016 00000100:00100000:2.0:1715208006.269132:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 405 00000100:00100000:2.0:1715208006.269136:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+28:5323:x1798523505046016:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1715208006.269144:0:10664:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208006.269150:0:10664:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878922c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55702e9 expref: -99 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.269169:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269174:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269178:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269189:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269192:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269196:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269217:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4df80/0xfa8b5bed878922dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269220:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4df80/0xfa8b5bed878922dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269224:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4df80/0xfa8b5bed878922dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00000004:00200000:2.0:1715208006.269235:0:10664:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000403:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1715208006.269237:0:10664:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715208006.269243:0:10664:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4df80/0xfa8b5bed878922dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269247:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269250:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269253:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269255:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4c000 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.269257:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269264:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269268:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715208006.269270:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.269272:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269275:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c000/0xfa8b5bed878922ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269280:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269283:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269287:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269289:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4e1c0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.269291:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269293:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269296:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbcd31978 (ffff88012e8eec00) 00010000:00010000:2.0:1715208006.269298:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.269299:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269301:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e1c0/0xfa8b5bed878922d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbcd31978 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.269315:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878922c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702e9 expref: 30 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.269320:0:10664:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4df80/0xfa8b5bed878922dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702e9 expref: 29 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.269324:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff88012e8ee700) 00010000:00010000:2.0:1715208006.269325:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1715208006.269326:0:10664:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4df80, rc 0) 00000100:00100000:2.0:1715208006.269351:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:5323:x1798523505046016:12345-192.168.201.23@tcp:101:rm.0 Request processed in 214us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208006.269356:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 405 00000100:00100000:0.0:1715208006.270228:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208006.270296:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505046080 00000100:00100000:2.0:1715208006.270300:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505046080 00000100:00100000:2.0:1715208006.270324:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 406 00000100:00100000:2.0:1715208006.270328:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:5323:x1798523505046080:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1715208006.270335:0:10664:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208006.270342:0:10664:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed878922e3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55702f0 expref: -99 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.270360:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 3/1,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.270365:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.270370:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271120:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271125:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271130:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271141:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271144:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271147:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271150:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4c240 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.271152:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271155:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271159:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff88012e8ee700) 00010000:00010000:2.0:1715208006.271160:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.271162:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271165:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c240/0xfa8b5bed878922ea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271170:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271177:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271180:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271182:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4dd40 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.271184:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271187:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271191:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x4d12f7d4 (ffff88012e8eef00) 00010000:00010000:2.0:1715208006.271192:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.271193:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271196:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4dd40/0xfa8b5bed878922f1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.271212:0:10664:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed878922e3 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702f0 expref: 30 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.271217:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed878922e3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702f0 expref: 30 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.271220:0:10664:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4e400, rc 0) 00000100:00100000:2.0:1715208006.271247:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:5323:x1798523505046080:12345-192.168.201.23@tcp:101:rm.0 Request processed in 918us (1020us total) trans 0 rc 301/301 00000100:00100000:2.0:1715208006.271251:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 406 00000100:00100000:0.0:1715208006.272266:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208006.272336:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505046144 00000100:00100000:2.0:1715208006.272340:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505046144 00000100:00100000:2.0:1715208006.272364:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 407 00000100:00100000:2.0:1715208006.272368:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:5323:x1798523505046144:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1715208006.272375:0:10664:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208006.272381:0:10664:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878922f8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55702f7 expref: -99 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.272400:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 3/1,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272405:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272410:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272416:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272419:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272422:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272432:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272434:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272437:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272445:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4e880 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.272447:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272450:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272455:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff88012e8ee700) 00010000:00010000:2.0:1715208006.272457:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.272458:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272461:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e880/0xfa8b5bed878922ff lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272467:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272470:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272473:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272475:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4d200 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.272477:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272479:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272482:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x4d12f7d4 (ffff88012e8ee100) 00010000:00010000:2.0:1715208006.272483:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.272487:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272490:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892306 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.272504:0:10664:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878922f8 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702f7 expref: 30 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.272508:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878922f8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702f7 expref: 30 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.272513:0:10664:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4ef40, rc 0) 00000100:00100000:2.0:1715208006.272539:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:5323:x1798523505046144:12345-192.168.201.23@tcp:101:rm.0 Request processed in 170us (274us total) trans 0 rc 301/301 00000100:00100000:2.0:1715208006.272543:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 407 00000100:00100000:0.0:1715208006.275575:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208006.275644:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505046272 00000100:00100000:2.0:1715208006.275648:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505046272 00000100:00100000:2.0:1715208006.275673:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 408 00000100:00100000:2.0:1715208006.275676:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:5324:x1798523505046272:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:2.0:1715208006.275683:0:10664:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208006.275689:0:10664:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789230d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55702fe expref: -99 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.275716:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275722:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275727:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275738:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4f180/0xfa8b5bed8789231b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275742:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4f180/0xfa8b5bed8789231b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275746:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4f180/0xfa8b5bed8789231b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00000004:00080000:2.0:1715208006.275868:0:10664:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1715208006.275937:0:10664:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4f600/0xfa8b5bed87892322 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275942:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4f600/0xfa8b5bed87892322 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275946:0:10664:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4f600/0xfa8b5bed87892322 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275957:0:10664:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275961:0:10664:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275963:0:10664:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275966:0:10664:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4eac0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208006.275968:0:10664:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275971:0:10664:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275979:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x0 (ffff88012e8ee700) 00010000:00010000:2.0:1715208006.275981:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208006.275983:0:10664:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.275986:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed87892314 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10664 initiator: MDT0 00000004:00010000:2.0:1715208006.275992:0:10664:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012ef8df80 reply state ffff88012d512000 transno 4294967439 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4f180/0xfa8b5bed8789231b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.276012:0:10664:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4f180/0xfa8b5bed8789231b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9:0x0].0x4d12f7d4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10664 initiator: MDT0 00010000:00010000:2.0:1715208006.276016:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9:0x0].0x4d12f7d4 (ffff88012e8eeb00) 00010000:00010000:2.0:1715208006.276017:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715208006.276019:0:10664:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715208006.276032:0:10664:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed8789230d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702fe expref: 32 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.276038:0:10664:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4f600/0xfa8b5bed87892322 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55702fe expref: 31 pid: 10664 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208006.276042:0:10664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff88012e8ee200) 00010000:00010000:2.0:1715208006.276043:0:10664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715208006.276044:0:10664:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4f600, rc 0) 00000100:00100000:2.0:1715208006.276069:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+32:5324:x1798523505046272:12345-192.168.201.23@tcp:101:dd.0 Request processed in 392us (495us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1715208006.276073:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 408 00000100:00100000:0.0:1715208006.286012:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208006.286087:0:7125:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505046400 00000100:00100000:2.0:1715208006.286096:0:7125:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505046400 00000100:00100000:2.0:1715208006.286123:0:7125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 69 00000100:00100000:2.0:1715208006.286127:0:7125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+32:5324:x1798523505046400:12345-192.168.201.23@tcp:35:dd.0 00000100:00100000:2.0:1715208006.286221:0:7125:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+33:5324:x1798523505046400:12345-192.168.201.23@tcp:35:dd.0 Request processed in 94us (223us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1715208006.286226:0:7125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 69 00000001:02000400:1.0:1715208006.590955:0:30512:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_22: @@@@@@ FAIL: cannot create /mnt/lustre2/d22.sanity-hsm/test_release with dd, status=1 00000040:00080000:3.0:1715208006.733934:0:15215:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715208006.733939:0:15215:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1715208006.734229:0:15215:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1715208006.734234:0:15215:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1715208006.775246:0:15218:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 Debug log: 413 lines, 413 kept, 0 dropped, 0 bad.