00000001:00100000:0.0F:1715207749.445429:0:8254:0:(tgt_lastrcvd.c:551:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 134fdbad-c6b8-4209-bac9-142c15f24ba7 00000020:00000080:0.0:1715207749.445446:0:8254:0:(genops.c:924:class_export_put()) final put ffff88009e098000/134fdbad-c6b8-4209-bac9-142c15f24ba7 00000020:00000080:2.0F:1715207749.445604:0:1805:0:(genops.c:882:class_export_destroy()) destroying export ffff88009e098000/134fdbad-c6b8-4209-bac9-142c15f24ba7 for lustre-MDT0001 00000020:00000080:2.0:1715207749.445711:0:1805:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff88009e099800 for lustre-MDT0001 00010000:00010000:3.0F:1715207749.728096:0:7112:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715207749.812033:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510602240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715207749.812086:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3685:1798523510602304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715207749.812116:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207749.812152:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602240 00000100:00100000:3.0:1715207749.812163:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602240 00000100:00100000:2.0:1715207749.812173:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207749.812212:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:3.0:1715207749.812222:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510602240:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715207749.812229:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602304 00000100:00100000:2.0:1715207749.812236:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602304 00000100:00080000:0.0:1715207749.812264:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207719 00000004:00000024:3.0:1715207749.812265:0:7128:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1316847616 00000100:00100000:2.0:1715207749.812285:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1715207749.812294:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800adc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3685:x1798523510602304:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715207749.812322:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510602240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (206us total) trans 0 rc 0/0 00002000:00000024:2.0:1715207749.812327:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000100:00100000:3.0:1715207749.812330:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00100000:0.0:1715207749.812358:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510602240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715207749.812405:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800adc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3685:x1798523510602304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207749.812433:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:3.0:1715207749.812451:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3685:1798523510602304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715207749.828103:0:3685:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715207749.828127:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510602368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715207749.828179:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207749.828220:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602368 00000100:00100000:2.0:1715207749.828226:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602368 00000100:00100000:2.0:1715207749.828287:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:2.0:1715207749.828297:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800adc1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510602368:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1715207749.828307:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207719 00002000:00000024:2.0:1715207749.828320:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000100:00100000:2.0:1715207749.828372:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800adc1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510602368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207749.828405:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00100000:3.0:1715207749.828424:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510602368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715207749.895013:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715207749.895064:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505019456 00000100:00100000:0.0:1715207749.895081:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505019456 00000100:00100000:0.0:1715207749.895174:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 329 00000100:00100000:0.0:1715207749.895188:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800adc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:24386:x1798523505019456:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1715207749.895350:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800adc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:24386:x1798523505019456:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 161us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207749.895402:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 329 00000100:00100000:0.0:1715207749.897014:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715207749.897148:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505019520 00000100:00100000:2.0:1715207749.897161:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505019520 00000100:00100000:2.0:1715207749.897224:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 330 00000100:00100000:2.0:1715207749.897233:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:24386:x1798523505019520:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715207749.897348:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:24386:x1798523505019520:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 114us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207749.897358:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 330 00000100:00100000:2.0:1715207749.899206:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715207749.899272:0:15069:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505019648 00000100:00100000:2.0:1715207749.899280:0:15069:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505019648 00000100:00100000:2.0:1715207749.899338:0:15069:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:2.0:1715207749.899348:0:15069:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800adc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:24386:x1798523505019648:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715207749.899611:0:15069:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800adc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+19:24386:x1798523505019648:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 260us (407us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1715207749.899625:0:15069:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00010000:00010000:2.0:1715207750.730120:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715207751.668059:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801247cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510602496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0F:1715207751.668066:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510602624:0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668125:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24597633-7c6c-43cc-a7e8-ad821c1018c0:3683:1798523510602432:0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668145:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207751.668146:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207751.668185:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207751.668193:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602496 00000100:00100000:0.0:1715207751.668196:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510602752:0@lo:400:kworker.0 00000100:00100000:1.0:1715207751.668197:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3686:1798523510602880:0@lo:400:kworker.0 00000100:00100000:2.0:1715207751.668204:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602496 00000100:00100000:3.0:1715207751.668207:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3683:1798523510602688:0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668223:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207751.668224:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207751.668241:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602432 00000100:00100000:0.0:1715207751.668241:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510603008:0@lo:400:kworker.0 00000100:00100000:1.0:1715207751.668242:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3686:1798523510603136:0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668246:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602432 00000100:00100000:2.0:1715207751.668251:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:2.0:1715207751.668258:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510602496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715207751.668266:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207751.668266:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207751.668275:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1715207751.668278:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510603264:0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668281:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880087dfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3683:x1798523510602432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715207751.668281:0:3686:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1715207751.668287:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3686:1798523510602560:0@lo:400:kworker.0 00002000:00000024:2.0:1715207751.668291:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 16080576 pending 0 free 3921453056 avail 3689930752 00000100:00100000:0.0:1715207751.668292:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207751.668306:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1715207751.668315:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207721 00000100:00080000:0.0:1715207751.668319:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207721 00000100:00100000:1.0:1715207751.668324:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3686:1798523510602816:0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668327:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880087dfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3683:x1798523510602432:12345-0@lo:400:kworker.0 Request processed in 46us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207751.668332:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602624 00000100:00100000:3.0:1715207751.668335:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1715207751.668366:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602624 00000100:00100000:2.0:1715207751.668369:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510602496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207751.668374:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207751.668377:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:1.0:1715207751.668387:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3686:1798523510603072:0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668394:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602752 00000100:00100000:0.0:1715207751.668397:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602752 00000100:00100000:3.0:1715207751.668401:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207751.668403:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:2.0:1715207751.668408:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3686:x1798523510602624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668413:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:1.0:1715207751.668417:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602880 00000100:00100000:0.0:1715207751.668418:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510602752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668422:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510602944:0@lo:400:kworker.0 00000100:00100000:1.0:1715207751.668422:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602880 00000100:00100000:2.0:1715207751.668445:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3686:x1798523510602624:12345-0@lo:400:kworker.0 Request processed in 36us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207751.668447:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207751.668452:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:1.0:1715207751.668453:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510603136 00000100:00100000:1.0:1715207751.668455:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510603136 00000100:00100000:3.0:1715207751.668460:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510603200:0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668462:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510602752:12345-0@lo:400:kworker.0 Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207751.668467:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602560 00000100:00100000:1.0:1715207751.668469:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602560 00000100:00100000:0.0:1715207751.668469:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:3.0:1715207751.668477:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207751.668477:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602816 00000100:00100000:1.0:1715207751.668479:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602816 00000100:00100000:2.0:1715207751.668484:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602688 00000100:00100000:2.0:1715207751.668488:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602688 00000100:00100000:1.0:1715207751.668491:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1715207751.668496:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1798523510602880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668505:0:11685:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510603008 00000100:00100000:2.0:1715207751.668506:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1715207751.668508:0:11685:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510603008 00000100:00100000:2.0:1715207751.668510:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1798523510603136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668521:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:24597633-7c6c-43cc-a7e8-ad821c1018c0:3683:1798523510602432:0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668527:0:11685:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510603264 00000100:00100000:0.0:1715207751.668529:0:11685:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510603264 00000100:00100000:1.0:1715207751.668533:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3686:x1798523510602880:12345-0@lo:400:kworker.0 Request processed in 37us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207751.668539:0:11685:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510602944 00000100:00100000:1.0:1715207751.668540:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:0.0:1715207751.668542:0:11685:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510602944 00000100:00100000:2.0:1715207751.668543:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3686:x1798523510603136:12345-0@lo:400:kworker.0 Request processed in 33us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207751.668549:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1715207751.668552:0:11685:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510603200 00000100:00100000:0.0:1715207751.668554:0:11685:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510603200 00000100:00100000:3.0:1715207751.668555:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:3.0:1715207751.668560:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1798523510602560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715207751.668560:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:1.0:1715207751.668564:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1798523510602816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668565:0:11685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1715207751.668570:0:11685:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510603008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207751.668573:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:2.0:1715207751.668577:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3683:x1798523510602688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668601:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3686:x1798523510602560:12345-0@lo:400:kworker.0 Request processed in 41us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207751.668607:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:0.0:1715207751.668610:0:11685:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510603008:12345-0@lo:400:kworker.0 Request processed in 40us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207751.668612:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3686:x1798523510602816:12345-0@lo:400:kworker.0 Request processed in 48us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207751.668615:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3683:x1798523510602688:12345-0@lo:400:kworker.0 Request processed in 38us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207751.668617:0:11685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1715207751.668618:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:2.0:1715207751.668621:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1715207751.668627:0:11685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1715207751.668631:0:11685:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510603264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668632:0:9918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:3.0:1715207751.668636:0:9918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3683:x1798523510602944:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1715207751.668643:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207721 00000100:00080000:1.0:1715207751.668647:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207721 00000100:00080000:1.0:1715207751.668649:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207721 00000100:00080000:1.0:1715207751.668651:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207721 00000100:00100000:0.0:1715207751.668651:0:11685:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510603264:12345-0@lo:400:kworker.0 Request processed in 20us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207751.668655:0:9387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1715207751.668660:0:11685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1715207751.668663:0:9918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3683:x1798523510602944:12345-0@lo:400:kworker.0 Request processed in 23us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207751.668663:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207751.668664:0:9387:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3683:x1798523510603200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668669:0:9918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:2.0:1715207751.668688:0:9387:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3683:x1798523510603200:12345-0@lo:400:kworker.0 Request processed in 29us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207751.668689:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3686:1798523510602880:0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668693:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510602752:0@lo:400:kworker.0 00000100:00100000:2.0:1715207751.668694:0:9387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1715207751.668697:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3683:1798523510602688:0@lo:400:kworker.0 00000100:00100000:1.0:1715207751.668699:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3686:1798523510603136:0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668704:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510603008:0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668707:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510602944:0@lo:400:kworker.0 00000100:00100000:1.0:1715207751.668708:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510602624:0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668716:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510603200:0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668724:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510603264:0@lo:400:kworker.0 00000100:00100000:1.0:1715207751.668730:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3686:1798523510602560:0@lo:400:kworker.0 00000100:00100000:0.0:1715207751.668738:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801247cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510602496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715207751.668739:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3686:1798523510602816:0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668750:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510603072 00000100:00100000:3.0:1715207751.668753:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510603072 00000100:00080000:1.0:1715207751.668785:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207721 00000100:00100000:3.0:1715207751.668794:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1715207751.668798:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1798523510603072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207751.668838:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3686:x1798523510603072:12345-0@lo:400:kworker.0 Request processed in 39us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207751.668844:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:1.0:1715207751.668906:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3686:1798523510603072:0@lo:400:kworker.0 00000100:00100000:2.0:1715207751.684118:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801247cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510603328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715207751.684158:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207751.684210:0:9389:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510603328 00000100:00100000:0.0:1715207751.684219:0:9389:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510603328 00000100:00100000:0.0:1715207751.684251:0:9389:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:0.0:1715207751.684257:0:9389:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510603328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1715207751.684273:0:9389:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 16080576 pending 0 free 3921453056 avail 3689930752 00000100:00100000:0.0:1715207751.684330:0:9389:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510603328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207751.684337:0:9389:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00100000:2.0:1715207751.684387:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801247cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510603328:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1715207751.737113:0:7113:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1715207752.732059:0:15215:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1715207752.732068:0:15215:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1715207752.732644:0:15215:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1715207752.732655:0:15215:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1715207752.740140:0:14811:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1715207752.774720:0:15218:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1715207752.819572:0:12124:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12s: race between restore requests ==== 18:35:52 (1715207752) 00000100:00100000:0.0:1715207752.931424:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715207752.931607:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505019840 00000100:00100000:3.0:1715207752.931625:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505019840 00000100:00100000:3.0:1715207752.931719:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 331 00000100:00100000:3.0:1715207752.931729:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+19:25660:x1798523505019840:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00000100:00080000:1.0:1715207752.931746:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207722 00010000:00010000:3.0:1715207752.931763:0:6554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715207752.931789:0:6554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72640/0xfa8b5bed87891f16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55700b9 expref: -99 pid: 6554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207752.931924:0:6554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.931942:0:6554:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.931959:0:6554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.931975:0:6554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.931982:0:6554:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.931988:0:6554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6554 initiator: MDT0 00000004:00200000:3.0:1715207752.932067:0:6554:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1715207752.932142:0:6554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932149:0:6554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932156:0:6554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932179:0:6554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88006ee70240 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:3.0:1715207752.932185:0:6554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932193:0:6554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932208:0:6554:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8801303a6000) 00010000:00010000:3.0:1715207752.932212:0:6554:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715207752.932216:0:6554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932222:0:6554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70240/0xfa8b5bed87891f1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932255:0:6554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932261:0:6554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932267:0:6554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932272:0:6554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88006ee70900 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:3.0:1715207752.932275:0:6554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932281:0:6554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932287:0:6554:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff880087de9500) 00010000:00010000:3.0:1715207752.932290:0:6554:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715207752.932306:0:6554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932313:0:6554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee70900/0xfa8b5bed87891f24 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6554 initiator: MDT0 00010000:00010000:3.0:1715207752.932387:0:6554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72640/0xfa8b5bed87891f16 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55700b9 expref: 21 pid: 6554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207752.932396:0:6554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72640/0xfa8b5bed87891f16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55700b9 expref: 21 pid: 6554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207752.932407:0:6554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006ee72640, rc 0) 00000100:00100000:3.0:1715207752.932493:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+20:25660:x1798523505019840:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 763us (1082us total) trans 4294967414 rc 301/301 00000100:00100000:3.0:1715207752.932503:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 331 00000100:00100000:0.0:1715207752.934855:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715207752.934979:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505019904 00000100:00100000:3.0:1715207752.934988:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505019904 00000100:00100000:3.0:1715207752.935022:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 332 00000100:00100000:3.0:1715207752.935029:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+20:25660:x1798523505019904:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715207752.935117:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+20:25660:x1798523505019904:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207752.935125:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 332 00000100:00100000:0.0:1715207752.936553:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715207752.936659:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505019968 00000100:00100000:3.0:1715207752.936668:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505019968 00000100:00100000:3.0:1715207752.936724:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 333 00000100:00100000:3.0:1715207752.936732:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:25660:x1798523505019968:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1715207752.936754:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207722 00000100:00100000:3.0:1715207752.936807:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:25660:x1798523505019968:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207752.936826:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 333 00000100:00100000:2.0:1715207752.948117:0:3685:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715207752.948144:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012d0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510603392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1715207752.948221:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207752.948296:0:7127:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510603392 00000100:00100000:0.0:1715207752.948310:0:7127:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510603392 00000100:00100000:2.0:1715207752.948459:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:2.0:1715207752.948471:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523510603392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1715207752.948527:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445052416 avail 1315590144 00000100:00100000:2.0:1715207752.948612:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523510603392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207752.948625:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00100000:1.0:1715207752.948646:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207752.948688:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505020288 00000100:00100000:1.0:1715207752.948695:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505020288 00000100:00100000:3.0:1715207752.948723:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d0afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510603392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715207752.948732:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 334 00000100:00100000:1.0:1715207752.948740:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+20:25663:x1798523505020288:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:1.0:1715207752.948754:0:6554:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715207752.948769:0:6554:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc900/0xfa8b5bed87891f32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55700dc expref: -99 pid: 6554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207752.948814:0:6554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948827:0:6554:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948836:0:6554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948849:0:6554:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948856:0:6554:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948862:0:6554:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948929:0:6554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948936:0:6554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948942:0:6554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948948:0:6554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bd440 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207752.948958:0:6554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948965:0:6554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948976:0:6554:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:1.0:1715207752.948980:0:6554:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207752.948984:0:6554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.948990:0:6554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd440/0xfa8b5bed87891f39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.949020:0:6554:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.949026:0:6554:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.949032:0:6554:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.949037:0:6554:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bc480 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207752.949039:0:6554:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.949045:0:6554:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.949051:0:6554:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1c17b0f7 (ffff8800a01d2700) 00010000:00010000:1.0:1715207752.949054:0:6554:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207752.949056:0:6554:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.949072:0:6554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc480/0xfa8b5bed87891f40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1c17b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6554 initiator: MDT0 00010000:00010000:1.0:1715207752.949103:0:6554:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc900/0xfa8b5bed87891f32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55700dc expref: 21 pid: 6554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207752.949112:0:6554:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bc900/0xfa8b5bed87891f32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55700dc expref: 21 pid: 6554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207752.949120:0:6554:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3bc900, rc 0) 00000100:00100000:1.0:1715207752.949167:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+20:25663:x1798523505020288:12345-192.168.201.23@tcp:101:rm.0 Request processed in 427us (526us total) trans 0 rc 301/301 00000100:00100000:1.0:1715207752.949176:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 334 00000001:02000400:1.0:1715207753.495914:0:12189:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12s: @@@@@@ FAIL: cannot create /mnt/lustre2/d12s.sanity-hsm/f12s.sanity-hsm with cp, status=1 00000040:00080000:1.0:1715207753.732130:0:15215:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1715207753.732141:0:15215:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1715207753.732737:0:15215:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1715207753.732748:0:15215:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1715207753.742195:0:9401:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1715207753.774628:0:15218:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 Debug log: 324 lines, 324 kept, 0 dropped, 0 bad.