00010000:00010000:3.0F:1715208059.734465:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715208059.996589:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508210304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715208059.996665:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1715208059.996749:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508210304 00000100:00100000:1.0:1715208059.996770:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508210304 00000100:00100000:1.0:1715208059.996854:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:1.0:1715208059.996866:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508210304:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0F:1715208059.996893:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715208029 00002000:00000024:1.0:1715208059.996917:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3853516800 avail 3851419648 00000100:00100000:1.0:1715208059.997026:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508210304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208059.997039:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1715208059.997070:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508210304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715208060.204511:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3216:1798523508210560:0@lo:400:kworker.0 00000100:00100000:0.0F:1715208060.204511:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3215:1798523508210496:0@lo:400:kworker.0 00000100:00100000:3.0:1715208060.204535:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3218:1798523508210432:0@lo:400:kworker.0 00000100:00100000:1.0:1715208060.204549:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a7775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47336e3e-5c2f-4892-9b72-90c87ec36b26:3217:1798523508210368:0@lo:400:kworker.0 00000100:00100000:0.0:1715208060.204592:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208060.204644:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508210496 00000100:00100000:1.0:1715208060.204650:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208060.204655:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508210496 00000100:00100000:1.0:1715208060.204673:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508210688:0@lo:400:kworker.0 00000100:00100000:2.0:1715208060.204675:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1715208060.204682:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715208030 00000100:00100000:0.0:1715208060.204698:0:8623:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508210432 00000100:00100000:2.0:1715208060.204702:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508210624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715208060.204702:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208060.204703:0:8623:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508210432 00000100:00100000:3.0:1715208060.204715:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:3.0:1715208060.204726:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3215:x1798523508210496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715208060.204733:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208060.204733:0:8623:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:1.0:1715208060.204737:0:8575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508210688 00000100:00100000:0.0:1715208060.204740:0:8623:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3218:x1798523508210432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715208060.204742:0:8575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508210688 00000100:00100000:2.0:1715208060.204767:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208060.204774:0:8575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1715208060.204781:0:8575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508210688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715208060.204786:0:8623:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3218:x1798523508210432:12345-0@lo:400:kworker.0 Request processed in 46us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208060.204791:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508210560 00000100:00100000:0.0:1715208060.204794:0:8623:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:2.0:1715208060.204796:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508210560 00000100:00100000:3.0:1715208060.204806:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3215:x1798523508210496:12345-0@lo:400:kworker.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208060.204818:0:8575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508210688:12345-0@lo:400:kworker.0 Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208060.204819:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:1.0:1715208060.204826:0:8575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1715208060.204826:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1715208060.204831:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3216:x1798523508210560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715208060.204846:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508210624 00000100:00100000:1.0:1715208060.204850:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508210624 00000100:00100000:3.0:1715208060.204854:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508210368 00000100:00100000:3.0:1715208060.204860:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508210368 00000100:00100000:0.0:1715208060.204860:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3216:x1798523508210560:12345-0@lo:400:kworker.0 Request processed in 28us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208060.204865:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880132972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3218:1798523508210432:0@lo:400:kworker.0 00000100:00100000:1.0:1715208060.204867:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:0.0:1715208060.204867:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:1.0:1715208060.204872:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508210624:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1715208060.204885:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715208030 00000100:00080000:0.0:1715208060.204889:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715208030 00000100:00080000:0.0:1715208060.204891:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715208030 00000100:00100000:2.0:1715208060.204894:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880132973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3216:1798523508210560:0@lo:400:kworker.0 00002000:00000024:1.0:1715208060.204895:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1715208060.204896:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:3.0:1715208060.204905:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3217:x1798523508210368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715208060.204951:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880132972680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3215:1798523508210496:0@lo:400:kworker.0 00000100:00100000:1.0:1715208060.204952:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508210624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208060.204960:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1715208060.204981:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508210624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715208060.204987:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3217:x1798523508210368:12345-0@lo:400:kworker.0 Request processed in 80us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208060.204999:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1715208060.205004:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a7775500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47336e3e-5c2f-4892-9b72-90c87ec36b26:3217:1798523508210368:0@lo:400:kworker.0 00000100:00100000:1.0:1715208060.205016:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880132971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508210688:0@lo:400:kworker.0 00000001:02000400:3.0:1715208060.282572:0:18345:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_24a: @@@@@@ FAIL: hsm flags on /mnt/lustre/d24a.sanity-hsm/f24a.sanity-hsm are Dumping lctl log to /tmp/testlogs//sanity-hsm.test_24a.*.1715208058.log != 0x00000000 00010000:00010000:2.0:1715208060.736508:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 73 lines, 73 kept, 0 dropped, 0 bad.