00000001:00080000:0.0F:1715207778.606473:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967440 is committed 00000100:00100000:2.0F:1715207778.718402:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715207778.718481:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0F:1715207778.718500:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915840 00000100:00100000:1.0:1715207778.718520:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915840 00000100:00100000:2.0:1715207778.718541:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0F:1715207778.718568:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915904 00000100:00080000:2.0:1715207778.718568:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207748 00000100:00100000:1.0:1715207778.718573:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1203 00000100:00100000:1.0:1715207778.718582:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1954:x1798523503915840:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:3.0:1715207778.718586:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915904 00000100:00100000:2.0:1715207778.718587:0:14590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915968 00000100:00100000:2.0:1715207778.718594:0:14590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915968 00000100:00100000:3.0:1715207778.718627:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1787 00000100:00100000:3.0:1715207778.718635:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+20:1955:x1798523503915904:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:2.0:1715207778.718635:0:14590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 922 00000100:00100000:2.0:1715207778.718646:0:14590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+7:1954:x1798523503915968:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1715207778.718650:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1954:x1798523503915840:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 68us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207778.718658:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1203 00000100:00100000:3.0:1715207778.718682:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d9c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+20:1955:x1798523503915904:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 47us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207778.718690:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1787 00000100:00100000:2.0:1715207778.718697:0:14590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d9c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+7:1954:x1798523503915968:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 52us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207778.718709:0:14590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 922 00000100:00080000:2.0:1715207778.718734:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207748 00010000:00010000:2.0:1715207779.174445:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715207779.450107:0:26842:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12t: @@@@@@ FAIL: failed to HSM archive /mnt/lustre/d12t.sanity-hsm/f12t.sanity-hsm 00000100:00100000:0.0:1715207779.548566:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508183616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715207779.548636:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207779.548758:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183616 00000100:00100000:2.0:1715207779.548770:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183616 00000100:00080000:0.0:1715207779.548832:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207749 00000100:00100000:2.0:1715207779.548838:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:2.0:1715207779.548846:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508183616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715207779.548883:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1715207779.548945:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508183616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207779.548954:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1715207779.548987:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508183616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715207779.756488:0:3216:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715207779.756511:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3216:1798523508183808:0@lo:400:kworker.0 00000100:00100000:3.0:1715207779.756536:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508184000:0@lo:400:kworker.0 00000100:00100000:0.0:1715207779.756561:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008dfd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3217:1798523508183872:0@lo:400:kworker.0 00000100:00100000:1.0:1715207779.756567:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508183680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715207779.756577:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207779.756596:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207779.756615:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47336e3e-5c2f-4892-9b72-90c87ec36b26:3216:1798523508183744:0@lo:400:kworker.0 00000100:00100000:0.0:1715207779.756617:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207779.756627:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207779.756642:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207779.756651:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013235f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3218:1798523508183936:0@lo:400:kworker.0 00000100:00100000:3.0:1715207779.756656:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183808 00000100:00100000:0.0:1715207779.756659:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183744 00000100:00100000:3.0:1715207779.756665:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183808 00000100:00100000:0.0:1715207779.756665:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183744 00000100:00100000:2.0:1715207779.756670:0:14590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508184000 00000100:00100000:1.0:1715207779.756670:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207779.756675:0:14590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508184000 00000100:00100000:3.0:1715207779.756699:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183872 00000100:00100000:3.0:1715207779.756702:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183872 00000100:00100000:1.0:1715207779.756702:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183936 00000100:00100000:1.0:1715207779.756707:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183936 00000100:00100000:0.0:1715207779.756707:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1715207779.756716:0:14590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:0.0:1715207779.756717:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3216:x1798523508183744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207779.756721:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:2.0:1715207779.756723:0:14590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508184000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207779.756728:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3216:x1798523508183808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715207779.756737:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:1.0:1715207779.756744:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1798523508183872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715207779.756789:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1798523508183872:12345-0@lo:400:kworker.0 Request processed in 45us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207779.756794:0:14590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508184000:12345-0@lo:400:kworker.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207779.756797:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:0.0:1715207779.756797:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3216:x1798523508183744:12345-0@lo:400:kworker.0 Request processed in 79us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207779.756799:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3216:x1798523508183808:12345-0@lo:400:kworker.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207779.756802:0:14590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1715207779.756809:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00100000:0.0:1715207779.756810:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1715207779.756814:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790 00000100:00100000:1.0:1715207779.756819:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013298ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3218:x1798523508183936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207779.756822:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183680 00000100:00100000:2.0:1715207779.756826:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183680 00000100:00100000:2.0:1715207779.756844:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1715207779.756845:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013298ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3218:x1798523508183936:12345-0@lo:400:kworker.0 Request processed in 24us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207779.756849:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013298ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508183680:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1715207779.756850:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207749 00000100:00100000:1.0:1715207779.756851:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790 00000100:00080000:0.0:1715207779.756856:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207749 00000100:00080000:0.0:1715207779.756860:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207749 00002000:00000024:2.0:1715207779.756880:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1715207779.756884:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013235f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3218:1798523508183936:0@lo:400:kworker.0 00000100:00100000:0.0:1715207779.756885:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008dfd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3217:1798523508183872:0@lo:400:kworker.0 00000100:00100000:2.0:1715207779.756925:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013298ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508183680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207779.756932:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1715207779.756945:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508183680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715207779.756963:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3216:1798523508183808:0@lo:400:kworker.0 00000100:00100000:2.0:1715207779.756973:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e4da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47336e3e-5c2f-4892-9b72-90c87ec36b26:3216:1798523508183744:0@lo:400:kworker.0 00000100:00100000:2.0:1715207779.756997:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508184000:0@lo:400:kworker.0 Debug log: 96 lines, 96 kept, 0 dropped, 0 bad.